Let's First Clarify the Basic Concept: What Is a Codec?
The word codec is short for the English term "coder/decoder." It is the algorithm responsible for compressing video data (encoding) and decompressing the compressed data (decoding). The camera sensor produces a massive amount of raw image data every second; if this data were recorded as is, file sizes would go far beyond usability. The codec compresses this data with a certain logic; at playback, it reconstructs the original image.
Here, a critical distinction that is often confused needs to be clarified from the start. Codec and Container are not the same thing. Extensions like .mp4, .mov, .mkv, .mxf are container formats; they represent the envelope that holds the content. The codec, on the other hand, is the compression logic inside the envelope. A .mov file can contain both H.264 and ProRes. An .mp4 can be encoded with both H.264 and H.265. This distinction is critically important especially at the video output delivery stage and in format conversions; the answer to the question "why won't it open?" lies exactly here.
Two Different Logics of Compression: Interframe and Intraframe
To understand video codecs, one must first grasp these two fundamental compression approaches. Because a significant portion of the differences between H.264, H.265, ProRes and RAW stems from this.
Interframe: Compression That Establishes Relationships Between Frames
Imagine an image: a fixed camera, a character moving in the middle. The background, however—the wall, the table, the window—does not change at all from one frame to the next. Interframe compression kicks in exactly here; it works with the logic of "why would I record again and again what isn't changing anyway?" It records the first frame (I-frame) completely, the entire background, the entire character, every pixel. In the following frames, it writes only what has changed. The character's new position. It does not record the background again. That is why files produced with H.264 and H.265 are small; as the video gets longer, the more the background stays fixed, the more efficient the file size remains.
But this efficiency comes at a cost at the editing desk. This entire structure is called a GOP (Group of Pictures). When the editing application wants to jump to a frame on the timeline, it has to recalculate the entire GOP chain leading to that frame from the beginning, because that frame does not exist on its own and gains meaning by referencing previous frames. The screen freezing when you move the playhead while editing H.264, the system stuttering—this is the direct result of that.
Intraframe: Compression That Completes Each Frame Within Itself
Let's return to the same image: fixed camera, moving character. This time the compression logic does not look at the background, does not consult the previous frame. It records each frame (whether the background is completely the same or different) completely and independently, one by one. ProRes works with this system. As a result, the file size is large; integrity, not efficiency, has been prioritized.
In return, complete freedom comes at the editing desk. Since each frame exists on its own, the editing application can jump instantly to any point on the timeline. There is no chain to calculate, no time to wait. The system does not stutter.
To keep it in mind, think of it this way:
Interframe establishes relationships between frames, stores the difference, the file stays small.
Intraframe, each frame is complete within itself, stores all of them, the file grows.
H.264: The World's Most Common Video Codec
H.264, officially known as AVC (Advanced Video Coding), was developed by JVT (Joint Video Team), a joint effort of ITU-T and ISO/IEC, and was standardized in 2003. Since that day, it has become the fundamental technology that brings video content together with the internet. YouTube, Vimeo, social media platforms, Blu-ray discs, security cameras, smartphone outputs... H.264 is the common denominator of them all.
Technical Profile:
In its typical application, it offers 8-Bit color depth and 4:2:0 chroma subsampling. 4:2:0 means that color information is halved both horizontally and vertically. A clever optimization that uses the fact that the human eye is much more sensitive to brightness than to color information. In terms of bitrate, there is a wide spectrum. While the 5-15 Mbps range is common for internet delivery, some upper-segment cameras can go up to 100 Mbps in 4K shooting.
Strengths:
Universal compatibility. Whichever device, whichever platform, whichever software you use, H.264 opens. The file size is small, transfer is easy, storage is cheap.
Weaknesses:
8-Bit color depth restricts color grading flexibility in post production. 4:2:0 chroma subsampling creates limitations in the green channel, opening the door to chroma errors especially in green screen shoots. The GOP structure, on the other hand, negatively affects editing performance. For projects requiring heavy color processing, H.264 is an insufficient shooting format.
Where to Use:
Web broadcasting, social media content, final format in productions with low color grading intensity. In other words, this codec is the format that carries the final product to the viewer.
H.265 / HEVC: Achieving the Same Quality with Half the Data
H.265, officially known as HEVC (High Efficiency Video Coding), was standardized in 2013. Its design goal was clear: to deliver the same image quality as H.264 at roughly half the file size. And it largely achieved this. The algorithm uses far more advanced compression blocks and prediction methods. As a result, it achieves similar visual quality using approximately forty to fifty percent less data compared to H.264. This advantage is especially critical for 4K and 8K content; carrying high-resolution content at reasonable file sizes is nearly impossible without H.265.
Technical Profile:
H.265 brought 10-bit color depth to a much wider field with mainstream camera and platform support. This depth, which is mandatory for HDR (High Dynamic Range) content, means dozens of times more color values in the transition from shadows to highlights. In terms of chroma subsampling, 4:2:0 is common, though some applications also offer 4:2:2 support.
Strengths:
Thanks to its efficiency, it carries 4K content at reasonable file sizes. With HDR and wide color gamut support, it is compatible with modern visual standards. Netflix and other major streaming platforms widely use H.265 for 4K HDR content.
Weaknesses:
Encode and Decode processes require significantly more processor power compared to H.264. On older systems without hardware H.265 acceleration, editing and playback can be problematic. Historically, patent licensing issues slowed the standard's adoption. This is why some platforms turned to open-source rival codecs like VP9 and AV1.
Use Case:
This codec is the format used for 4K content delivery, modern streaming platforms, and shooting and archiving scenarios where storage efficiency is a priority.
Apple ProRes: The Workhorse of Post Production
ProRes is an intraframe codec introduced by Apple in 2007 with Final Cut Studio 2, designed for professional post production. Today it is the most common intermediate format standard in film, advertising, news, and digital content production.
The ProRes family is not a single codec but consists of multiple variants that respond to different needs:
ProRes 422 Proxy:
The member of the family with the smallest file size. It exists not for final output but for editing speed: it is preferred on low-capacity systems or when you need to quickly move to assembly editing after intense shooting days. It is the primary carrier of the proxy workflow.
ProRes 422 LT:
A step above Proxy; more color data, still a reasonable file size. For environments where storage is limited but quality is not to be fully compromised.
ProRes 422:
The standard post production format; the exact middle of the balance. Most editing and color work passes through here.
ProRes 422 HQ:
The high-quality version; for critical color grading projects and broadcast delivery jobs.
ProRes 4444:
4:4:4 chroma subsampling and 12-bit color depth. With alpha channel support, it is the go-to format for VFX and motion graphics workflows.
ProRes 4444 XQ:
The family's highest quality and file size solution; for those who want to keep data loss close to zero.
The ProRes 422 family offers 10-bit color depth and 4:2:2 chroma subsampling. In 4:2:2, color information is halved only horizontally, while vertical information is preserved. This is a meaningful increase in color quality compared to H.264's 4:2:0. This difference is distinctly felt especially in green or blue screen shoots where chroma-related issues come to the fore.
Why do editors love ProRes?
Thanks to its intraframe structure, the editing application can access each frame independently. Jumping back and forth on the timeline does not strain the CPU, and the system does not stutter. Final Cut Pro, Adobe Premiere Pro, and DaVinci Resolve all handle ProRes like a native format. According to Apple's own documentation, ProRes 422 HQ produces approximately 220 Mbps bitrate at 1920×1080 - 29.97 fps. This corresponds to approximately 100 GB per hour. When moving to 4K, these figures rise dramatically.
Disadvantage:
File size. ProRes is not a delivery format; it is a post production format. Some cameras (certain ARRI, Sony, and Blackmagic models) can record ProRes directly. In this case, it serves as both the shooting and editing format. But no platform delivers ProRes content to viewers.
Use Case:
Intermediate format during editing, projects requiring intense color grading, VFX workflows, broadcast and advertising productions.
RAW: Raw Data, Pure Control
RAW is not a technical codec name but a category. It defines the family of formats that record the data coming from the camera sensor in its least processed state, without debayer (color interpretation) processing. Each manufacturer develops its own RAW variant.
ARRIRAW
The format used by ARRI cameras (Alexa, AMIRA series); the reference standard of the cinema industry.
REDCODE RAW (.R3D)
The proprietary format of RED cameras, offering variable compression ratios.
Cinema DNG
The open-source RAW standard adopted by Blackmagic and some other manufacturers.
Canon Cinema RAW Light (.CRM)
The format of Canon cinema cameras.
In RAW video, each pixel carries the raw light value that the sensor measured at that point. Color interpretation — white balance, color science — is entirely left to post production. This means that some mistakes made during shooting, provided you stay within the correct exposure range, can be compensated for later. Maximum flexibility is available in color grading work because you are working with the raw data of the image.
In terms of dynamic range, the RAW format offers data closest to the theoretical maximum of the camera sensor. This means more recovery capacity in both shadows and overexposed areas. If you are pushing the limits of light in a scene, this advantage of RAW becomes practically visible in post production.
Disadvantage:
Almost everything. File sizes are extraordinarily large. Every frame must undergo debayer processing in post production; this requires serious processor load and specialized software. The workflow becomes complicated, crew requirements increase, costs rise.
Use Case:
Feature films, high-budget commercials and music videos, any project where color work is of central importance. It covers all jobs where "finishing everything in-camera" is not possible and the image must be shaped in post production.
Which Codec for Which Job? A Practical Decision Guide
To turn all this technical knowledge into a concrete decision, it is enough to ask yourself a few questions before shooting.
What is the video recording for?
If it is for social media, a platform or a website, delivery is done with H.264 or H.265. No platform serves ProRes or RAW to the viewer.
How critical is color grading?
If you are planning aggressive color grading, 8-Bit H.264 cannot handle it. Banding, chroma noise and color breakups become inevitable. 10-Bit H.265 or ProRes is required. If there is intensive VFX or extensive color science work, consider ProRes 4444 or RAW.
What is your editing workflow like?
If you are going to edit the material you shot directly and your system is not powerful, you will struggle with H.264. Either a proxy workflow must be set up or the intraframe advantage of ProRes must be used.
Do you have storage and budget?
RAW and ProRes 4K shooting requires serious storage infrastructure. On limited budgets, H.265 offers a strong balance point.
Which formats does your camera support?
This question may need to be put at the very top of the list. The entire codec discussion is limited to the options the camera offers. Many camera operators research which codec they should choose but only later realize that the camera they have only records H.264. Get to know your camera first; have the discussion within those limits.
DID YOU KNOW? - 7 QUESTIONS 7 ANSWERS
No. A container (wrapper format) is the file structure that holds video, audio and metadata together: like .mp4, .mov, .mkv... A codec, on the other hand, is the algorithm that determines how the video is compressed inside. A .mov file can contain both H.264 and ProRes. Confusing these two concepts leads to inconsistent errors, especially at the delivery and format conversion stages.
If a side-by-side comparison is made at the same bitrate, yes. Especially in scenes with motion, H.265 is less prone to block artifacts. But H.265's real advantage is not image superiority, it is efficiency: it offers the same quality as H.264 in a much smaller file. For equivalent quality, H.265 uses about half the capacity. This means a serious gain, especially in 4K and streaming scenarios.
Because of file size. ProRes is designed for editing and color processing. According to Apple's documentation, ProRes 422 HQ produces a bitrate of approximately 220 Mbps at 1080p/29.97. That means about 100 GB per hour. When you move to 4K, this figure easily exceeds 300 GB. Also, not all platforms and devices can play ProRes without problems. The final output is always converted to a delivery codec such as H.264 or H.265.
In terms of image quality it is much less critical because in RAW the in-camera color interpretation is transferred to post-production. It records the white balance as metadata, it does not process it into the pixels. Theoretically it can be changed freely in post-production. But shooting at the correct white balance speeds up the post-production process and allows the eye to work with a reliable reference image. The "it's RAW, I'll fix it" approach is technically correct but operationally costly.
Because of the GOP (Group of Pictures) structure. In H.264, not every frame is a complete image on its own. Some frames contain only change information relative to the previous or next frames. When the editing application wants to go to a specific frame, it has to calculate the GOP chain from the beginning. This causes jumping back and forth on the timeline to be slow and CPU-intensive. There is no such problem in ProRes. Every frame is independent and instantly accessible.
An 8-Bit channel has 256 distinct color values. In 10-Bit, this number rises to 1024. When the three channels are considered together, the difference means an enormous color space. While 8-Bit offers approximately 16.7 million colors, 10-Bit theoretically contains over 1 billion color values. During color grading, this depth directly prevents the banding problem, which is a dead end especially in sky gradients and skin tones. Two different color transitions that are close to each other look much smoother and more flawless.
No. Instagram, YouTube, TikTok and all other platforms re-encode (transcode) the uploaded video according to their own codec and bitrate standards. Whether you upload H.264 or ProRes, the platform ultimately applies its own compression. However, when the quality of the starting file is high, the loss after re-encoding is less. That is why it makes sense to use high bitrate H.264 or H.265 for delivery to a platform. Uploading ProRes increases file size but affects the result in image quality very little.
