Versioning
What is dataset versioning?
Dataset versioning pins which rows, labels, and derived features a training or eval run used.
Updated · Part of What is time travel?
How it works
- The training run records the table version.
- Labels and features are columns at that version.
- A later run can see the diff.
What it is not
It is not a folder named v2, and it is not versioning only the model weights.
dataset versioning: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Pins | Rows and labels | A zip file name |
| Includes | Derived columns | Weights only |
| Compare | Two versions of the table | Two notebooks |
Where Pixeltable fits
Pixeltable table versions are the pin. A training run can name the version it read.
Questions
- How does dataset versioning work?
- The training run records the table version. Labels and features are columns at that version. A later run can see the diff.
- What is dataset versioning often confused with?
- It is not a folder named v2, and it is not versioning only the model weights.