Versioning
What is data lineage?
Data lineage traces an output back to the source rows, the model, and the column definition that produced it.
Updated
How it works
- The output column names its inputs.
- The row names the source media.
- You follow those links when you need to explain a value.
What it is not
It is not an audit log of who logged in, and it is not a screenshot of a job graph.
data lineage: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Traces | Output to source and expression | User logins |
| Stored as | Dependencies and versions | A drawing |
| Question | Why is this caption here? | Who deployed last Tuesday? |
Where Pixeltable fits
Pixeltable lineage is the dependency graph plus table versions, so a computed value can be traced to the row and the expression.
Questions
- How does data lineage work?
- The output column names its inputs. The row names the source media. You follow those links when you need to explain a value.
- What is data lineage often confused with?
- It is not an audit log of who logged in, and it is not a screenshot of a job graph.