Multimodal data

What is a video column?

A video column stores a clip with a timeline, so frames, audio, and timestamps stay addressable from the row.

Updated · Part of What is a typed media column?

How it works

  • The row points at the clip and remembers it is video.
  • A view can walk frames at a chosen rate without losing the parent clip.
  • Transcripts and detections are further columns on those frames or on the clip.

What it is not

It is not a bucket object you decode in a separate job, and it is not a chat model that rewatches the file on every question.

video column: this, and the thing it is confused with

video column: this, and the thing it is confused with
ThisNot this
StoredA clip with a timelineA file you ffprobe by hand
Child rowsFrames with timestampsLoose JPEGs in a folder
Query resultA moment in that clipOnly the filename

Where Pixeltable fits

Pixeltable types the column as pxt.Video. Frame views and transcript columns hang off that value.

Questions

How does video column work?
The row points at the clip and remembers it is video. A view can walk frames at a chosen rate without losing the parent clip. Transcripts and detections are further columns on those frames or on the clip.
What is video column often confused with?
It is not a bucket object you decode in a separate job, and it is not a chat model that rewatches the file on every question.