How Is Video Represented on Computers?
Digital video is stored as a sequence of frames (still images) paired with audio, encoded using specific algorithms and wrapped in container formats. Understanding the basics helps in choosing the right tools for editing, streaming, or archiving.
Core Representation Methods
- Raw / Uncompressed: Every pixel stored (e.g., YUV 4:2:2). Massive file sizes (.mov, .avi). Used in professional editing.
- Lossless Compression: Codecs like HuffYUV, FFV1, Apple ProRes RAW reduce size without quality loss. Ideal for archiving and intermediate editing.
- Lossy Compression: H.264/AVC, H.265/HEVC, VP9, AV1 discard imperceptible data. Standard for streaming, playback, and distribution (.mp4, .mkv, .webm).
- Streaming Formats: Segmented delivery (HLS, DASH) with adaptive bitrate, served over HTTP.
Key Concepts
- Container (.mp4, .mkv) – Holds video, audio, subtitles, metadata.
- Codec (H.264, AV1) – Encodes/decodes the actual streams.
- Parameters: Resolution, frame rate, bit depth, chroma subsampling define quality and file size.
Choose raw/lossless for editing, lossy for delivery, lossless for long‑term archiving.