Multimodal data
What is an audio column?
An audio column stores a waveform or audio container the schema can transcribe, embed, or synthesize from.
Updated · Part of What is a typed media column?
How it works
- The row stores the clip as audio.
- A computed column can write a transcript.
- Search can run over that transcript, or over an embedding of it.
What it is not
It is not a video soundtrack that was never given a type of its own.
audio column: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Stored | Audio the schema can open | A video file you only watch |
| Typical output | Transcript text | A waveform plot |
| Search | Words or similar speech | Filename |
Where Pixeltable fits
Pixeltable types it as pxt.Audio. A transcript assignment on that column is the usual next step.
Questions
- How does audio column work?
- The row stores the clip as audio. A computed column can write a transcript. Search can run over that transcript, or over an embedding of it.
- What is audio column often confused with?
- It is not a video soundtrack that was never given a type of its own.