Data Engineer Interview Question

How do you track data lineage, and why does it matter operationally?

What the interviewer is probing, how to structure your answer, and a spoken example you can adapt.

Quick answer

Lineage maps which sources feed which tables, models, and dashboards. Capture it automatically by parsing SQL and orchestrator dependencies rather than maintaining it by hand, since manual lineage rots within weeks. It matters because it answers the three urgent questions: what breaks if this source fails, who do I notify about a bad load, and can I safely delete or change this column.

Why interviewers ask this

This question probes whether you think past building pipelines to running a platform other people depend on. Interviewers want automated capture, column level lineage where it is available, and concrete uses: impact analysis before a change, blast radius during an incident, and compliance deletion. Answers that describe a wiki page reveal inexperience at scale.

How to structure your answer

  • Define lineage and the level of detail worth capturing.
  • Insist on automatic capture from SQL and orchestration metadata.
  • Give the three operational questions it answers.
  • Connect it to change management and deprecation.
  • Mention ownership metadata alongside lineage.

Example answer

Spoken example, first person

Lineage is the dependency graph of your data, ideally down to column level, and the only version worth having is the one generated automatically. Anything hand maintained is wrong within a month. In practice we got most of it free from dbt's manifest for the transformation layer, plus the BI tool's metadata for dashboards, feeding a catalog. The value shows up in three moments. When a source is late, I can immediately tell which dashboards will be stale and message those owners before they message me. When someone wants to drop a column, impact analysis takes thirty seconds instead of a grep and a prayer. And for deletion requests, I can find every table containing a given identifier. The thing I would add is that lineage without ownership is only half useful. Every dataset needs a named owning team attached, otherwise you know exactly what broke and still have nobody to tell.

Walking into this interview soon? GhostPilot listens to your live call, spots the question the moment it is asked, and puts a structured answer on your screen in real time. Try it on your next mock, or grab a $29 Session Pass, no subscription, for the real thing.

See how it works

Follow-up questions to expect

  • How would you capture lineage for a pipeline written in Python, not SQL?
  • What is the difference between table level and column level lineage?
  • How do you keep a data catalog from becoming stale?

Related data engineer questions

Your interviewer will ask their own version of this. Paste your actual job description into the free Question Predictor and get the 20 questions that role is most likely to ask, with what each one is really probing.

Predict my questions

Rehearse the hard questions before they are asked

Practise with a live copilot, then walk in ready. A $29 Session Pass gets you through the interview with no subscription and no lock-in.

Get GhostPilot