FFMPEG(1)

๐Ÿ’… FFMPEG(1) โ€” the ffmpeg media converter, bestie edition โœจ

Okay so this is the FFMPEG(1) manual, and we are gonna make it make sense. No cap.

๐ŸŽ€ NAME ๐ŸŽ€

ffmpeg โ€” ffmpeg media converter. Thatโ€™s the whole name section, bestie. Slay.

โœจ SYNOPSIS โœจ

ffmpeg [global_options] {[input_file_options] -i input_url} ...
{[output_file_options] output_url} ...

๐Ÿฆ‹ DESCRIPTION ๐Ÿฆ‹

So ffmpeg is literally a universal media converter. It can read a wide variety of inputs โ€” including live grabbing/recording devices โ€” filter them, and transcode them into a plethora of output formats. Obsessed.

ffmpeg reads from an arbitrary number of inputs (which can be regular files, pipes, network streams, grabbing devices, etc.), specified by the -i option, and writes to an arbitrary number of outputs, which are specified by a plain output url. Anything found on the command line which cannot be interpreted as an option is considered to be an output url. Thatโ€™s the vibe check.

Each input or output can, in principle, contain any number of elementary streams of different types (video/audio/subtitle/attachment/data), though the allowed stream counts and/or types may be limited by the container format. Selecting which streams from which inputs will go into which output is either done automatically or with the -map option (see the Stream selection chapter).

To refer to inputs/outputs in options, you must use their indices (0-based). E.g. the first input is 0, the second is 1, etc. Similarly, streams within an input/output are referred to by their indices. E.g. 2:3 refers to the fourth stream in the third input or output. Also see the Stream specifiers chapter. Iykyk.

As a general rule, options are applied to the next specified file. Therefore, order is important, and you can have the same option on the command line multiple times. Each occurrence is then applied to the next input or output file. Exceptions from this rule are the global options (e.g. verbosity level), which should be specified first.

๐Ÿšจ Do not mix input and output files โ€” first specify all input files, then all output files. Also do not mix options which belong to different files. All options apply ONLY to the next input or output file and are reset between files. Periodt.

Some simple examples follow.

  • Convert an input media file to a different format, by re-encoding media streams:
ffmpeg -i input.avi output.mp4
  • Set the video bitrate of the output file to 64 kbit/s:
ffmpeg -i input.avi -b:v 64k -bufsize 64k output.mp4
  • Force the frame rate of the output file to 24 fps:
ffmpeg -i input.avi -r 24 output.mp4
  • Force the frame rate of the input file (valid for raw formats only) to 1 fps and the frame rate of the output file to 24 fps:
ffmpeg -r 1 -i input.m2v -r 24 output.mp4

The format option may be needed for raw input files. Donโ€™t forget that, bestie.

๐ŸŒˆ DETAILED DESCRIPTION ๐ŸŒˆ

ffmpeg builds a transcoding pipeline out of the components listed below. The programโ€™s operation then consists of input data chunks flowing from the sources down the pipes towards the sinks, while being transformed by the components they encounter along the way. Itโ€™s giving assembly line, but make it media.

The following kinds of components are available:

  • Demuxers (short for โ€œdemultiplexersโ€) โ€” read an input source in order to extract:
    • global properties such as metadata or chapters;
    • list of input elementary streams and their properties.

One demuxer instance is created for each -i option, and sends encoded packets to decoders or muxers.

In other literature, demuxers are sometimes called splitters, because their main function is splitting a file into elementary streams (though some files only contain one elementary stream).

A schematic representation of a demuxer looks like this:

        โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
        โ”‚ demuxer  โ”‚                       โ”‚ packets for stream 0
        โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก elementary stream 0   โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
        โ”‚          โ”‚                       โ”‚
        โ”‚  global  โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
        โ”‚propertiesโ”‚                       โ”‚ packets for stream 1
        โ”‚   and    โ”‚ elementary stream 1   โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
        โ”‚ metadata โ”‚                       โ”‚
        โ”‚          โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
        โ”‚          โ”‚                       โ”‚
        โ”‚          โ”‚     ...........       โ”‚
        โ”‚          โ”‚                       โ”‚
        โ”‚          โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
        โ”‚          โ”‚                       โ”‚ packets for stream N
        โ”‚          โ”‚ elementary stream N   โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
        โ”‚          โ”‚                       โ”‚
        โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
             โ–ฒ
             โ”‚
             โ”‚ read from file, network stream,
             โ”‚     grabbing device, etc.
             โ”‚
  • Decoders โ€” receive encoded (compressed) packets for an audio, video, or subtitle elementary stream, and decode them into raw frames (arrays of pixels for video, PCM for audio). A decoder is typically associated with (and receives its input from) an elementary stream in a demuxer, but sometimes may also exist on its own (see Loopback decoders).

A schematic representation of a decoder looks like this:

                             โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                    packets  โ”‚         โ”‚ raw frames
                   โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚ decoder โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
                             โ”‚         โ”‚
                             โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
  • Filtergraphs โ€” process and transform raw audio or video frames. A filtergraph consists of one or more individual filters linked into a graph. Filtergraphs come in two flavors โ€” simple and complex, configured with the -filter and -filter_complex options, respectively.

A simple filtergraph is associated with an output elementary stream; it receives the input to be filtered from a decoder and sends filtered output to that output streamโ€™s encoder.

A simple video filtergraph that performs deinterlacing (using the yadif deinterlacer) followed by resizing (using the scale filter) can look like this:

                     โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                     โ”‚  simple filtergraph    โ”‚
         frames from โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก frames for
         a decoder   โ”‚  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”‚ an encoder
        โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”œโ”€โ–บโ”‚ yadif โ”œโ”€โ–บโ”‚ scale โ”œโ”€โ–บโ”‚โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
                     โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ”‚
                     โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

A complex filtergraph is standalone and not associated with any specific stream. It may have multiple (or zero) inputs, potentially of different types (audio or video), each of which receiving data either from a decoder or another complex filtergraphโ€™s output. It also has one or more outputs that feed either an encoder or another complex filtergraphโ€™s input. Main character energy, honestly.

The following example diagram represents a complex filtergraph with 3 inputs and 2 outputs (all video):

                  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                  โ”‚               complex filtergraph               โ”‚
                  โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
         frames   โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”      โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค frames
        โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚input 0โ”œโ”€โ–บโ”‚ overlay โ”œโ”€โ”€โ”€โ”€โ”€โ–บโ”‚ overlay โ”œโ”€โ–บโ”‚output 0โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
                  โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ”‚         โ”‚      โ”‚         โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
         frames   โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”โ•ญโ–บโ”‚         โ”‚    โ•ญโ–บโ”‚         โ”‚           โ”‚
        โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚input 1โ”œโ•ฏ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜           โ”‚
                  โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜                 โ”‚                       โ”‚
         frames   โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ•ฏ              โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค frames
        โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚input 2โ”œโ–บโ”‚scaleโ”œโ–บโ”‚splitโ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚output 1โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
                  โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”˜                โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
                  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

Frames from second input are overlaid over those from the first. Frames from the third input are rescaled, then the duplicated into two identical streams. One of them is overlaid over the combined first two inputs, with the result exposed as the filtergraphโ€™s first output. The other duplicate ends up being the filtergraphโ€™s second output. Iconic behavior.

  • Encoders โ€” receive raw audio, video, or subtitle frames and encode them into encoded packets. The encoding (compression) process is typically lossy โ€” it degrades stream quality to make the output smaller; some encoders are lossless, but at the cost of much higher output size. A video or audio encoder receives its input from some filtergraphโ€™s output, subtitle encoders receive input from a decoder (since subtitle filtering is not supported yet). Every encoder is associated with some muxerโ€™s output elementary stream and sends its output to that muxer.

A schematic representation of an encoder looks like this:

So the encoder hands off like this, bestie:

                                โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                    raw frames  โ”‚         โ”‚ packets
                   โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚ encoder โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บ
                                โ”‚         โ”‚
                                โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
  • Muxers (short for "multiplexers") โ€” okay so the muxers are the ones receiving encoded packets for their elementary streams, and they get them from encoders (that's the transcoding path ๐Ÿ›ฃ๏ธ) or straight-up directly from demuxers (that's the streamcopy path). Then they interleave them (only when there's more than one elementary stream, obvi) and write the resulting bytes into the output file (or pipe, network stream, etc.). A schematic of a muxer is literally giving:
                                          โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                    packets for stream 0  โ”‚                      โ”‚   muxer   โ”‚
                   โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚  elementary stream 0 โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
                                          โ”‚                      โ”‚           โ”‚
                                          โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค  global   โ”‚
                    packets for stream 1  โ”‚                      โ”‚properties โ”‚
                   โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚  elementary stream 1 โ”‚   and     โ”‚
                                          โ”‚                      โ”‚ metadata  โ”‚
                                          โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค           โ”‚
                                          โ”‚                      โ”‚           โ”‚
                                          โ”‚     ...........      โ”‚           โ”‚
                                          โ”‚                      โ”‚           โ”‚
                                          โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค           โ”‚
                    packets for stream N  โ”‚                      โ”‚           โ”‚
                   โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚  elementary stream N โ”‚           โ”‚
                                          โ”‚                      โ”‚           โ”‚
                                          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”˜
                                                                       โ”‚
                                        write to file, network stream, โ”‚
                                            grabbing device, etc.      โ”‚
                                                                       โ”‚
                                                                       โ–ผ

๐Ÿฆ‹ Streamcopy ๐Ÿฆ‹

Okay so the simplest pipeline in ffmpeg is single-stream streamcopy โ€” that's copying one input elementary stream's packets without decoding, filtering, or encoding them. Zero extra steps, we love a low-effort icon ๐Ÿ’…

Take an input file called INPUT.mkv with 3 elementary streams, and we're grabbing the second one and writing it to OUTPUT.mp4. The schematic of that pipeline is:

        โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
        โ”‚ demuxer  โ”‚                     โ”‚ unused
        โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก elementary stream 0 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ณ
        โ”‚          โ”‚                     โ”‚
        โ”‚INPUT.mkv โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค          โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
        โ”‚          โ”‚                     โ”‚ packets  โ”‚                      โ”‚   muxer   โ”‚
        โ”‚          โ”‚ elementary stream 1 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚  elementary stream 0 โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
        โ”‚          โ”‚                     โ”‚          โ”‚                      โ”‚OUTPUT.mp4 โ”‚
        โ”‚          โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
        โ”‚          โ”‚                     โ”‚ unused
        โ”‚          โ”‚ elementary stream 2 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ณ
        โ”‚          โ”‚                     โ”‚
        โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

And you build that whole vibe with this commandline:

ffmpeg -i INPUT.mkv -map 0:1 -c copy OUTPUT.mp4

In this commandline:

  • there is a single input INPUT.mkv;
  • there are no input options for this input;
  • there is a single output OUTPUT.mp4;
  • there are two output options for this output:
    • -map 0:1 selects the input stream to be used โ€” from input with index 0 (i.e. the first one) the stream with index 1 (i.e. the second one);
    • -c copy selects the copy encoder, i.e. streamcopy with no decoding or encoding.

Streamcopy is lowkey the goat for changing the elementary stream count, container format, or modifying container-level metadata. Since there's no decoding or encoding happening, it's very fast and there's no quality loss. Periodt. โœจ

But bestie, hear me โ€” it might not work in some cases because of a variety of factors (e.g. certain information required by the target container is not available in the source). Applying filters is obviously also impossible, since filters work on decoded frames. No decoded frames = no filter slay. ๐Ÿ˜ญ

More complex streamcopy scenarios can be constructed too โ€” like combining streams from two input files into a single output:

        โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”         โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
        โ”‚ demuxer 0โ”‚                    โ”‚ packets โ”‚                    โ”‚   muxer   โ”‚
        โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•กelementary stream 0 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚elementary stream 0 โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
        โ”‚INPUT0.mkvโ”‚                    โ”‚         โ”‚                    โ”‚OUTPUT.mp4 โ”‚
        โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜         โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค           โ”‚
        โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”         โ”‚                    โ”‚           โ”‚
        โ”‚ demuxer 1โ”‚                    โ”‚ packets โ”‚elementary stream 1 โ”‚           โ”‚
        โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•กelementary stream 0 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚                    โ”‚           โ”‚
        โ”‚INPUT1.aacโ”‚                    โ”‚         โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
        โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

which can be built by the commandline

ffmpeg -i INPUT0.mkv -i INPUT1.aac -map 0:0 -map 1:0 -c copy OUTPUT.mp4

The output -map option is used twice here, creating two streams in the output file โ€” one fed by the first input and one by the second. The single instance of the -c option selects streamcopy for both of those streams. You could also use multiple instances of this option together with Stream specifiers to apply different values to each stream, as will be demonstrated in following sections. ๐Ÿ‘€

A converse scenario is splitting multiple streams from a single input into multiple outputs:

        โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”          โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
        โ”‚ demuxer  โ”‚                     โ”‚ packets  โ”‚                   โ”‚ muxer 0   โ”‚
        โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก elementary stream 0 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚elementary stream 0โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
        โ”‚          โ”‚                     โ”‚          โ”‚                   โ”‚OUTPUT0.mp4โ”‚
        โ”‚INPUT.mkv โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
        โ”‚          โ”‚                     โ”‚ packets  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
        โ”‚          โ”‚ elementary stream 1 โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚                   โ”‚ muxer 1   โ”‚
        โ”‚          โ”‚                     โ”‚          โ”‚elementary stream 0โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
        โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜          โ”‚                   โ”‚OUTPUT1.mp4โ”‚
                                                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

built with

ffmpeg -i INPUT.mkv -map 0:0 -c copy OUTPUT0.mp4 -map 0:1 -c copy OUTPUT1.mp4

Not me needing to point out: a separate instance of the -c option is needed for every output file, even though their values are the same. Why? Because non-global options (which is most of them) only apply in the context of the file before which they are placed. Positions matter, bestie. ๐ŸŽฏ

These examples can of course be further generalized into arbitrary remappings of any number of inputs into any number of outputs. Go feral. ๐ŸŒ€


๐ŸŒˆ Transcoding ๐ŸŒˆ

Transcoding is the process of decoding a stream and then encoding it again. And since encoding tends to be computationally expensive and in most cases degrades the stream quality (i.e. it is lossy), you should only transcode when you need to and perform streamcopy otherwise. Do not transcode for fun, I'm begging ๐Ÿ™

Typical reasons to transcode are:

  • applying filters โ€” e.g. resizing, deinterlacing, or overlaying video; resampling or mixing audio;
  • you want to feed the stream to something that cannot decode the original codec.
Heads up: ffmpeg will transcode all audio, video, and subtitle streams unless you specify -c copy for them. So if you only meant to touch one thing, say so, or the whole file is getting re-encoded. ๐Ÿ˜ญ

Consider an example pipeline that reads an input file with one audio and one video stream, transcodes the video and copies the audio into a single output file. This can be schematically represented as follows

okay so hereโ€™s the full pipeline picture for that exact transcoding flow โ€” yes, itโ€™s giving very much diagram energy ๐Ÿ’…

               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
               โ”‚ demuxer  โ”‚                     โ”‚       audio packets
               โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก stream 0 (audio)    โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ
               โ”‚          โ”‚                     โ”‚                                     โ”‚
               โ”‚INPUT.mkv โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค video    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”     raw        โ”‚
               โ”‚          โ”‚                     โ”‚ packets  โ”‚  video  โ”‚ video frames   โ”‚
               โ”‚          โ”‚ stream 1 (video)    โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚ decoder โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ โ”‚
               โ”‚          โ”‚                     โ”‚          โ”‚         โ”‚              โ”‚ โ”‚
               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜              โ”‚ โ”‚
                                                                                    โ–ผ โ–ผ
                                                                                    โ”‚ โ”‚
               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” video    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”              โ”‚ โ”‚
               โ”‚ muxer    โ”‚                     โ”‚ packets  โ”‚  video  โ”‚              โ”‚ โ”‚
               โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก stream 0 (video)    โ”‚โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค encoder โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ โ”‚
               โ”‚          โ”‚                     โ”‚          โ”‚(libx264)โ”‚                โ”‚
               โ”‚OUTPUT.mp4โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜                โ”‚
               โ”‚          โ”‚                     โ”‚                                     โ”‚
               โ”‚          โ”‚ stream 1 (audio)    โ”‚โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ
               โ”‚          โ”‚                     โ”‚
               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

and the commandline that implements it is literally:

ffmpeg -i INPUT.mkv -map 0:v -map 0:a -c:v libx264 -c:a copy OUTPUT.mp4

Notice how it uses stream specifiers :v and :a to select input streams and apply different values of the -c option to them; see the Stream specifiers section for more details. ๐Ÿซถ

Filtering โœจ

When youโ€™re transcoding, audio and video streams can be filtered before encoding, with either a simple or complex filtergraph. no cap, thatโ€™s the whole vibe check.

Simple filtergraphs ๐ŸŽ€

Simple filtergraphs are those that have exactly one input and output, both of the same type (audio or video). Theyโ€™re configured with the per-stream -filter option (with -vf and -af aliases for -filter:v (video) and -filter:a (audio) respectively). Heads up: simple filtergraphs are tied to their output stream, so e.g. if you have multiple audio streams, -af will create a separate filtergraph for each one. the way that works is lowkey important ๐Ÿ’…

Taking the transcoding example from above, adding filtering (and omitting audio, for clarity) makes it look like this:

               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
               โ”‚ demuxer  โ”‚               โ”‚          โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
               โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก video stream  โ”‚ packets  โ”‚  video  โ”‚ frames
               โ”‚INPUT.mkv โ”‚               โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚ decoder โ”œโ”€โ”€โ”€โ”€โ”€โ–บโ”€โ”€โ”€โ•ฎ
               โ”‚          โ”‚               โ”‚          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜         โ”‚
               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜                              โ”‚
                                                 โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ
                                                 โ”‚   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                                                 โ”‚   โ”‚  simple filtergraph    โ”‚
                                                 โ”‚   โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
                                                 โ”‚   โ”‚  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”‚
                                                 โ•ฐโ”€โ”€โ–บโ”œโ”€โ–บโ”‚ yadif โ”œโ”€โ–บโ”‚ scale โ”œโ”€โ–บโ”œโ•ฎ
                                                     โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ”‚โ”‚
                                                     โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜โ”‚
                                                                               โ”‚
                                                                               โ”‚
               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” video    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”               โ”‚
               โ”‚ muxer    โ”‚               โ”‚ packets  โ”‚  video  โ”‚               โ”‚
               โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก video stream  โ”‚โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค encoder โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ
               โ”‚OUTPUT.mp4โ”‚               โ”‚          โ”‚         โ”‚
               โ”‚          โ”‚               โ”‚          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

Complex filtergraphs ๐ŸŒˆ

Complex filtergraphs are those which cannot be described as simply a linear processing chain applied to one stream. This is the case, for example, when the graph has more than one input and/or output, or when output stream type is different from input. Complex filtergraphs are configured with the -filter_complex option. Note that this option is global, since a complex filtergraph, by its nature, cannot be unambiguously associated with a single stream or file. Each instance of -filter_complex creates a new complex filtergraph, and there can be any number of them. periodt.

A trivial example of a complex filtergraph is the overlay filter, which has two video inputs and one video output, containing one video overlaid on top of the other. Its audio counterpart is the amix filter. iconic behavior, honestly.

Loopback decoders ๐ŸŒ€

While decoders are normally associated with demuxer streams, it is also possible to create โ€œloopbackโ€ decoders that decode the output from some encoder and allow it to be fed back to complex filtergraphs. This is done with the -dec directive, which takes as a parameter the index of the output stream that should be decoded. Every such directive creates a new loopback decoder, indexed with successive integers starting at zero. These indices should then be used to refer to loopback decoders in complex filtergraph link labels, as described in the documentation for -filter_complex.

Decoding AVOptions can be passed to loopback decoders by placing them before -dec, analogously to input/output options. iykyk ๐Ÿงš

E.g. the following example:

ffmpeg -i INPUT                                        \
  -map 0:v:0 -c:v libx264 -crf 45 -f null -            \
  -threads 3 -dec 0:0                                  \
  -filter_complex '[0:v][dec:0]hstack[stack]'          \
  -map '[stack]' -c:v ffv1 OUTPUT

reads an input video and

  • (line 2) encodes it with libx264 at low quality;
  • (line 3) decodes this encoded stream using 3 threads;
  • (line 4) places decoded video side by side with the original input video;
  • (line 5) combined video is then losslessly encoded and written into OUTPUT.

Such a transcoding pipeline can be represented with the following diagram:

               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
               โ”‚ demuxer  โ”‚               โ”‚   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”            โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
               โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก video stream  โ”‚   โ”‚  video  โ”‚            โ”‚  video  โ”‚    โ”‚ null muxer         โ”‚
               โ”‚   INPUT  โ”‚               โ”œโ”€โ”€โ–บโ”‚ decoder โ”œโ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–บโ”‚ encoder โ”œโ”€โ”ฌโ”€โ–บโ”‚(discards its input)โ”‚
               โ”‚          โ”‚               โ”‚   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ”‚         โ”‚(libx264)โ”‚ โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜                โ”‚         โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ”‚
                                                โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ—„โ”€โ”€โ•ฏ   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”       โ”‚
                                                โ”‚              โ”‚loopback โ”‚       โ”‚
                                                โ”‚ โ•ญโ”€โ”€โ”€โ”€โ”€โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”ค decoder โ”œโ”€โ”€โ”€โ”€โ—„โ”€โ”€โ•ฏ
                                                โ”‚ โ”‚            โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                                                โ”‚ โ”‚
                                                โ”‚ โ”‚
                                                โ”‚ โ”‚  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                                                โ”‚ โ”‚  โ”‚complex filtergraphโ”‚
                                                โ”‚ โ”‚  โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก
                                                โ”‚ โ”‚  โ”‚  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”‚
                                                โ•ฐโ”€โ•ซโ”€โ–บโ”œโ”€โ–บโ”‚   hstack    โ”œโ”€โ–บโ”œโ•ฎ
                                                  โ•ฐโ”€โ–บโ”œโ”€โ–บโ”‚             โ”‚  โ”‚โ”‚
                                                     โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ”‚โ”‚
                                                     โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜โ”‚
                                                                          โ”‚
               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”                  โ”‚
               โ”‚ muxer    โ”‚               โ”‚  โ”‚  video  โ”‚                  โ”‚
               โ•žโ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•ก video stream  โ”‚โ—„โ”€โ”ค encoder โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ—„โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ
               โ”‚  OUTPUT  โ”‚               โ”‚  โ”‚ (ffv1)  โ”‚
               โ”‚          โ”‚               โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

๐Ÿ’… STREAM SELECTION ๐Ÿ’…

okay so ffmpeg gives you the -map option for manual control of stream selection in each output file. You can totally skip -map and let ffmpeg do automatic stream selection like described below. And the -vn / -an / -sn / -dn options can skip inclusion of video, audio, subtitle and data streams respectively โ€” whether they were manually mapped or automatically selected โ€” except for those streams which are outputs of complex filtergraphs. ๐Ÿ’–

๐Ÿซถ Description ๐Ÿซถ

The sub-sections that follow describe the various rules that are involved in stream selection. The examples that follow next show how these rules are applied in practice. โœจ

While every effort is made to accurately reflect the behavior of the program, FFmpeg is under continuous development and the code may have changed since the time of this writing. iykyk ๐Ÿ‘€

โœจ Automatic stream selection โœจ

In the absence of any map options for a particular output file, ffmpeg inspects the output format to check which type of streams can be included in it, viz. video, audio and/or subtitles. For each acceptable stream type, ffmpeg will pick one stream, when available, from among all the inputs. ๐ŸŽ€

It will select that stream based upon the following criteria:

  • for video, it is the stream with the highest resolution,
  • for audio, it is the stream with the most channels,
  • for subtitles, it is the first subtitle stream found but there's a caveat. The output format's default subtitle encoder can be either text-based or image-based, and only a subtitle stream of the same type will be chosen.

In the case where several streams of the same type rate equally, the stream with the lowest index is chosen. lowkey iconic behavior ๐Ÿ‘‘

Data or attachment streams are not automatically selected and can only be included using -map. No cap. ๐Ÿ’€

๐ŸŽ€ Manual stream selection ๐ŸŽ€

When -map is used, only user-mapped streams are included in that output file, with one possible exception for filtergraph outputs described below. ๐Ÿซถ

๐Ÿฆ‹ Complex filtergraphs ๐Ÿฆ‹

If there are any complex filtergraph output streams with unlabeled pads, they will be added to the first output file. This will lead to a fatal error if the stream type is not supported by the output format. like, actual fatal error, bestie ๐Ÿ˜ญ In the absence of the map option, the inclusion of these streams leads to the automatic stream selection of their types being skipped. If map options are present, these filtergraph streams are included in addition to the mapped streams.

Complex filtergraph output streams with labeled pads must be mapped once and exactly once. once. and. exactly. once. ๐Ÿ’…

๐ŸŒธ Stream handling ๐ŸŒธ

Stream handling is independent of stream selection, with an exception for subtitles described below. Stream handling is set via the -codec option addressed to streams within a specific output file. In particular, codec options are applied by ffmpeg after the stream selection process and thus do not influence the latter. If no -codec option is specified for a stream type, ffmpeg will select the default encoder registered by the output file muxer. โœจ

An exception exists for subtitles. If a subtitle encoder is specified for an output file, the first subtitle stream found of any type, text or image, will be included. ffmpeg does not validate if the specified encoder can convert the selected stream or if the converted stream is acceptable within the output format. This applies generally as well: when the user sets an encoder manually, the stream selection process cannot check if the encoded stream can be muxed into the output file. If it cannot, ffmpeg will abort and all output files will fail to be processed. so maybe double-check that vibe before you hit enter ๐Ÿ™ˆ

๐Ÿ’– Examples ๐Ÿ’–

The following examples illustrate the behavior, quirks and limitations of ffmpeg's stream selection methods. ๐Ÿ“

They assume the following three input files.

input file 'A.avi'
      stream 0: video 640x360
      stream 1: audio 2 channels

input file 'B.mp4'
      stream 0: video 1920x1080
      stream 1: audio 2 channels
      stream 2: subtitles (text)
      stream 3: audio 5.1 channels
      stream 4: subtitles (text)

input file 'C.mkv'
      stream 0: video 1280x720
      stream 1: audio 2 channels
      stream 2: subtitles (image)

๐ŸŽฌ Example: automatic stream selection ๐ŸŽฌ

ffmpeg -i A.avi -i B.mp4 out1.mkv out2.wav -map 1:a -c:a copy out3.mov

There are three output files specified, and for the first two, no -map options are set, so ffmpeg will select streams for these two files automatically. ๐Ÿ’ซ

out1.mkv is a Matroska container file and accepts video, audio and subtitle streams, so ffmpeg will try to select one of each type. For video, it will select stream 0 from B.mp4, which has the highest resolution among all the input video streams. For audio, it will select stream 3 from B.mp4, since it has the greatest number of channels. For subtitles, it will select stream 2 from B.mp4, which is the first subtitle stream from among A.avi and B.mp4. slay selection logic ๐ŸŒˆ

out2.wav accepts only audio streams, so only stream 3 from B.mp4 is selected. ๐ŸŽง

For out3.mov, since a -map option is set, no automatic stream selection will occur. The -map 1:a option will select all audio streams from the second input B.mp4. No other streams will be included in this output file. manual mode activated ๐Ÿ’…

For the first two outputs, all included streams will be transcoded. The encoders chosen will be the default ones registered by each output format, which may not match the codec of the selected input streams.

For the third output, codec option for audio streams has been set to copy, so no decoding-filtering-encoding operations will occur, or can occur. Packets of selected streams shall be conveyed from the input file and muxed within the output file. copy means copy, no little chemistry set in the middle โœจ

๐ŸŽฌ Example: automatic subtitles selection ๐ŸŽฌ

ffmpeg -i C.mkv out1.mkv -c:s dvdsub -an out2.mkv

Although out1.mkv is a Matroska container file which accepts subtitle streams, only a video and audio stream shall be selected. The subtitle stream of C.mkv is image-based and the default subtitle encoder of the Matroska muxer is text-based, so a transcode operation for the subtitles is expected to fail and hence the stream isn't selected. it's giving mismatch ๐Ÿ˜ญ However, in out2.mkv, a subtitle encoder is specified in the command and so, the subtitle stream is selected, in addition to the video stream. The presence of -an disables audio stream selection for out2.mkv. ๐ŸŽ€

๐ŸŽฌ Example: unlabeled filtergraph outputs ๐ŸŽฌ

ffmpeg -i A.avi -i C.mkv -i B.mp4 -filter_complex "overlay" out1.mp4 out2.srt

A filtergraph is setup here using the -filter_complex option and consists of a single video filter. The overlay filter requires exactly two video inputs, but none are specified, so the first two available video streams are used, those of A.avi and C.mkv. The output pad of the filter has no label and so is sent to the first output file out1.mp4. Due to this, automatic selection of the video stream is skipped, which would have selected the stream in B.mp4. The audio stream with most channels viz. stream 3 in B.mp4, is chosen automatically. No subtitle stream is chosen however, since the MP4 format has no default subtitle encoder registered, and the user hasn't specified a subtitle encoder. ๐Ÿฆ‹

The 2nd output file, out2.srt, only accepts text-based subtitle streams. So, even though the first subtitle stream available belongs to C.mkv, it is image-based and hence skipped. The selected stream, stream 2 in B.mp4, is the first text-based subtitle stream. first text-based wins, periodt ๐Ÿ’…

๐ŸŽฌ Example: labeled filtergraph outputs ๐ŸŽฌ

ffmpeg -i A.avi -i B.mp4 -i C.mkv -filter_complex "[1:v]hue=s=0[outv];overlay;aresample" \
       -map '[outv]' -an        out1.mp4 \
                                out2.mkv \
       -map '[outv]' -map 1:a:0 out3.mkv

The above command will fail, as the output pad labelled [outv] has been mapped twice. None of the output files shall be processed. rip, no outputs for anyone ๐Ÿ’€

ffmpeg -i A.avi -i B.mp4 -i C.mkv -filter_complex "[1:v]hue=s=0[outv];overlay;aresample" \
       -an        out1.mp4 \
                  out2.mkv \
       -map 1:a:0 out3.mkv

This command above will also fail as the hue filter output has a label, [outv], and hasn't been mapped anywhere. labeled pad left on read, and ffmpeg is not okay with that ๐Ÿ˜ญ

The command should be modified as follows,

ffmpeg -i A.avi -i B.mp4 -i C.mkv -filter_complex "[1:v]hue=s=0,split=2[outv1][outv2];overlay;aresample" \
        -map '[outv1]' -an        out1.mp4 \
                                  out2.mkv \
        -map '[outv2]' -map 1:a:0 out3.mkv

The video stream from B.mp4 is sent to the hue filter, whose output is cloned once using the split filter, and both outputs labelled. Then a copy each is mapped to the first and third output files. โœจ

The overlay filter, requiring two video inputs, uses the first two unused video streams. Those are the streams from A.avi and C.mkv. The overlay output isn't labelled, so it is sent to the first output file out1.mp4, regardless of the presence of the -map option. ๐ŸŽ€

The aresample filter is sent the first unused audio stream, that of A.avi. Since this filter output is also unlabelled, it too is mapped to the first output file. The presence of -an only suppresses automatic or manual stream selection of audio streams, not outputs sent from filtergraphs. Both these mapped streams shall be ordered before the mapped stream in out1.mp4. filtergraph outputs said โ€œweโ€™re not listening to -anโ€ ๐Ÿ’…

The video, audio and subtitle streams mapped to out2.mkv are entirely determined by automatic stream selection.

out3.mkv consists of the cloned video output from the hue filter and the first audio stream from B.mp4. iconic little muxing moment ๐ŸŒˆ


โœจ OPTIONS โœจ

All the numerical options, if not specified otherwise, accept a string representing a number as input, which may be followed by one of the SI unit prefixes, for example: K, M, or G. ๐Ÿ”ข

If i is appended to the SI unit prefix, the complete prefix will be interpreted as a unit prefix for binary multiples, which are based on powers of 1024 instead of powers of 1000. Appending B to the SI unit prefix multiplies the value by 8. This allows using, for example: KB, MiB, G and B as number suffixes. numbers with little outfits on โœจ

Options which do not take arguments are boolean options, and set the corresponding value to true. They can be set to false by prefixing the option name with no. For example using -nofoo will set the boolean option with name foo to false. ๐Ÿซถ

Options that take arguments support a special syntax where the argument given on the command line is interpreted as a path to the file from which the actual argument value is loaded. To use this feature, add a forward slash / immediately before the option name (after the leading dash). E.g.

ffmpeg -i INPUT -/filter:v filter.script OUTPUT

...will load a filtergraph description from the file named filter.script. yes bestie, that's literally it ๐Ÿ’…


โœจ STREAM SPECIFIERS โœจ

okay so some options are per-stream โ€” like bitrate or codec, right? and stream specifiers are how you point at exactly which stream(s) an option belongs to ๐ŸŽฏ

a stream specifier is a string that you generally slap onto the end of the option name, separated by a colon. like -codec:a:1 ac3 โ€” see the a:1 in there? that's the stream specifier, and it matches the second audio stream. so this command picks the ac3 codec for the second audio stream. slay ๐Ÿ’…

and a stream specifier can match several streams at once, so the option just applies to all of them. for example the stream specifier in -b:a 128k matches all audio streams. group effort fr fr ๐Ÿซถ

an empty stream specifier matches all streams. like, -codec copy or -codec: copy would copy all the streams without reencoding. no reencoding, no stress, we love a lazy queen ๐Ÿ‘‘

possible forms of stream specifiers are:

  • stream_index โ€” matches the stream with this index. e.g. -threads:1 4 sets the thread count for the second stream to 4. and if stream_index is used as an additional stream specifier (peep below), then it selects stream number stream_index from the matching streams. stream numbering is based on the order of the streams as detected by libavformat โ€” except when a stream group specifier or program ID is also specified, in which case it's based on the ordering of the streams in the group or program. iykyk ๐ŸŒธ
  • stream_type[:additional_stream_specifier] โ€” stream_type is one of these: v or V for video, a for audio, s for subtitle, d for data, and t for attachments. v matches all video streams, but V only matches video streams which are not attached pictures, video thumbnails or cover arts. if additional_stream_specifier is used, then it matches streams which both have this type and match the additional stream specifier. otherwise, it matches all streams of the specified type โœจ
  • g:group_specifier[:additional_stream_specifier] โ€” matches streams which are in the group with the specifier group_specifier. if additional_stream_specifier is used, then it matches streams which both are part of the group and match the additional_stream_specifier. group_specifier may be one of the following:
    • group_index โ€” match the stream with this group index.
    • #group_id or i:group_id โ€” match the stream with this group id.
  • p:program_id[:additional_stream_specifier] โ€” matches streams which are in the program with the id program_id. if additional_stream_specifier is used, then it matches streams which both are part of the program and match the additional_stream_specifier ๐ŸŽ€
  • #stream_id or i:stream_id โ€” match the stream by stream id (e.g. PID in MPEG-TS container). obsessed with the specificity ๐Ÿฆ‹
  • m:key[:value] โ€” matches streams with the metadata tag key having the specified value. if value is not given, it matches streams that contain the given tag with any value. heads up tho: the colon character : in key or value needs to be backslash-escaped. escape your colons bestie ๐Ÿ˜ญ
  • disp:dispositions[:additional_stream_specifier] โ€” matches streams with the given disposition(s). dispositions is a list of one or more dispositions (as printed by the -dispositions option) joined with + ๐Ÿ‘‘
  • u โ€” matches streams with usable configuration. the codec must be defined and the essential information such as video dimension or audio sample rate must be present. it's giving "vibe check passed" โœ…
ngl, note that in ffmpeg, matching by metadata will only work properly for input files. keep that in mind ๐Ÿ’€

๐ŸŒˆ GENERIC OPTIONS ๐ŸŒˆ

these options are shared amongst the ff* tools. like, all of them. they're family ๐Ÿ’–

  • -L, -license โ€” show license. boring but legally iconic ๐Ÿ“œ
  • -h, -?, -help, --help [arg] โ€” show help. you can throw an optional parameter in there to print help about a specific item. if no argument is specified, only basic (non advanced) tool options are shown โœจ

possible values of arg are:

  • long โ€” print advanced tool options in addition to the basic tool options.
  • full โ€” print complete list of options, including shared and private options for encoders, decoders, demuxers, muxers, filters, etc. it's literally everything ๐Ÿ‘‘
  • decoder=decoder_name โ€” print detailed information about the decoder named decoder_name. use the -decoders option to get a list of all decoders.
  • encoder=encoder_name โ€” print detailed information about the encoder named encoder_name. use the -encoders option to get a list of all encoders.
  • demuxer=demuxer_name โ€” print detailed information about the demuxer named demuxer_name. use the -formats option to get a list of all demuxers and muxers.
  • muxer=muxer_name โ€” print detailed information about the muxer named muxer_name. use the -formats option to get a list of all muxers and demuxers.
  • filter=filter_name โ€” print detailed information about the filter named filter_name. use the -filters option to get a list of all filters.
  • bsf=bitstream_filter_name โ€” print detailed information about the bitstream filter named bitstream_filter_name. use the -bsfs option to get a list of all bitstream filters.
  • protocol=protocol_name โ€” print detailed information about the protocol named protocol_name. use the -protocols option to get a list of all protocols.
  • -version โ€” show version. say hi to your build ๐ŸŒธ
  • -buildconf โ€” show the build configuration, one option per line. receipts, basically ๐Ÿงพ
  • -formats โ€” show available formats (including devices). the whole lineup ๐Ÿ’…
  • -demuxers โ€” show available demuxers.
  • -muxers โ€” show available muxers.
  • -devices โ€” show available devices.
  • -codecs โ€” show all codecs known to libavcodec.
ok important note: the term "codec" is used throughout this documentation as a shortcut for what is more correctly called a media bitstream format. just so we're all on the same page ๐Ÿซถ
  • -decoders โ€” show available decoders.
  • -encoders โ€” show all available encoders.
  • -bsfs โ€” show available bitstream filters.
  • -protocols โ€” show available protocols.
  • -filters โ€” show available libavfilter filters. yes the library has a filter named libavfilter, we contain multitudes โœจ
  • -pix_fmts โ€” show available pixel formats.
  • -sample_fmts โ€” show available sample formats.
  • -layouts โ€” show channel names and standard channel layouts.
  • -dispositions โ€” show stream dispositions.
  • -colors โ€” show recognized color names. aesthetic reference sheet ๐ŸŽจ
  • -sources device[,opt1=val1[,opt2=val2]...] โ€” show autodetected sources of the input device. some devices may provide system-dependent source names that cannot be autodetected. and the returned list cannot be assumed to be always complete. so like, it's a vibe, not a promise ๐Ÿ™ˆ
ffmpeg -sources pulse,server=192.168.0.4
  • -sinks device[,opt1=val1[,opt2=val2]...] โ€” show autodetected sinks of the output device. some devices may provide system-dependent sink names that cannot be autodetected. and same deal, the returned list cannot be assumed to be always complete ๐Ÿ’…
ffmpeg -sinks pulse,server=192.168.0.4
  • -loglevel [flags+]loglevel, -v [flags+]loglevel โ€” set logging level and flags used by the library. this is your "how much do you want me to talk" dial ๐Ÿ—ฃ๏ธ

the optional flags prefix can consist of the following values:

  • repeat โ€” indicates that repeated log output should not be compressed to the first line and the "Last message repeated n times" line will be omitted.
  • level โ€” indicates that log output should add a [level] prefix to each message line. this can be used as an alternative to log coloring, e.g. when dumping the log to file.
  • time โ€” indicates that log lines should be prefixed with time information.
  • datetime โ€” indicates that log lines should be prefixed with date and time information. timestamps bestie ๐Ÿ•

flags can also be used alone by adding a +/- prefix to set/reset a single flag without affecting other flags or changing loglevel. when setting both flags and loglevel, a + separator is expected between the last flags value and before loglevel โœจ

loglevel is a string or a number containing one of the following values:

  • quiet, -8 โ€” show nothing at all; be silent. the introvert setting ๐Ÿคซ
  • panic, 0 โ€” only show fatal errors which could lead the process to crash, such as an assertion failure. this is not currently used for anything. ghost feature fr ๐Ÿ’€
  • fatal, 8 โ€” only show fatal errors. these are errors after which the process absolutely cannot continue.
  • error, 16 โ€” show all errors, including ones which can be recovered from.
  • warning, 24 โ€” show all warnings and errors. any message related to possibly incorrect or unexpected events will be shown.
  • info, 32 โ€” show informative messages during processing. this is in addition to warnings and errors. this is the default value ๐Ÿ‘‘
  • verbose, 40 โ€” same as info, except more verbose. she talks more ๐Ÿ’…
  • debug, 48 โ€” show everything, including debugging information.
  • trace, 56 โ€” (the maximum of the drama scale, no notes given) ๐Ÿ”ฅ

for example, to enable repeated log output, add the level prefix, and set loglevel to verbose:

ffmpeg -loglevel repeat+level+verbose -i input output

another example that enables repeated log output without affecting current state of level prefix flag or loglevel:

ffmpeg [...] -loglevel +repeat

by default the program logs to stderr. if coloring is supported by the terminal, colors are used to mark errors and warnings. log coloring can be disabled setting the environment variable AV_LOG_FORCE_NOCOLOR, or can be forced setting the environment variable AV_LOG_FORCE_COLOR. pink error messages are a lifestyle ๐Ÿ’–

  • -report โ€” dump full command line and log output to a file named program-YYYYMMDD-HHMMSS.log in the current directory. this file can be useful for bug reports. it also implies -loglevel debug ๐Ÿ“

setting the environment variable FFREPORT to any value has the same effect. if the value is a :-separated key=value sequence, these options will affect the report; option values must be escaped if they contain special characters or the options delimiter : (see the ``Quoting and escaping'' section in the ffmpeg-utils manual).

the following options are recognized:

  • file โ€” set the file name to use for the report; %p is expanded to the name of the program, %t is expanded to a timestamp, %% is expanded to a plain %
  • level โ€” set the log verbosity level using a numerical value (see -loglevel).

for example, to output a report to a file named ffreport.log using a log level of 32 (alias for log level info):

FFREPORT=file=ffreport.log:level=32 ffmpeg -i input output

And if parsing that environment variable goes sideways? Not fatal, bestie โ€” those errors wonโ€™t show up in the report. ๐Ÿซถ

  • -hide_banner โ€” Suppress printing the banner. All FFmpeg tools will normally show a copyright notice, build options and library versions, and this option can be used to suppress printing this information.
  • -cpuflags flags (global) โ€” Allows setting and clearing cpu flags. This option is intended for testing. Do not use it unless you know what youโ€™re doing.

Examples, because seeing it is believing:

ffmpeg -cpuflags -sse+mmx ...
ffmpeg -cpuflags mmx ...
ffmpeg -cpuflags 0 ...

Possible flags for this option are:

  • x86
    • mmx
    • mmxext
    • sse
    • sse2
    • sse2slow
    • sse3
    • sse3slow
    • ssse3
    • atom
    • sse4.1
    • sse4.2
    • avx
    • avx2
    • xop
    • fma3
    • fma4
    • 3dnow
    • 3dnowext
    • bmi1
    • bmi2
    • cmov
  • ARM
    • armv5te
    • armv6
    • armv6t2
    • vfp
    • vfpv3
    • neon
    • setend
  • AArch64
    • armv8
    • vfp
    • neon
  • PowerPC
    • altivec
  • Specific Processors
    • pentium2
    • pentium3
    • pentium4
    • k6
    • k62
    • athlon
    • athlonxp
    • k8
  • -cpucount count (global) โ€” Override detection of CPU count. This option is intended for testing. Do not use it unless you know what youโ€™re doing.
ffmpeg -cpucount 2
  • -max_alloc bytes โ€” Set the maximum size limit for allocating a block on the heap by ffmpegโ€™s family of malloc functions. Exercise extreme caution when using this option. Donโ€™t use if you do not understand the full consequence of doing so. Default is INT_MAX.

๐Ÿ’– AVOptions ๐Ÿ’–

These options are provided directly by the libavformat, libavdevice and libavcodec libraries. To see the list of available AVOptions, use the -help option. They are separated into two categories:

๐ŸŒธ generic

These options can be set for any container, codec or device. Generic options are listed under AVFormatContext options for containers/devices and under AVCodecContext options for codecs.

๐Ÿฆ‹ private

These options are specific to the given container, device or codec. Private options are listed under their corresponding containers/devices/codecs.

For example to write an ID3v2.3 header instead of a default ID3v2.4 to an MP3 file, use the id3v2_version private option of the MP3 muxer:

ffmpeg -i input.flac -id3v2_version 3 out.mp3

All codec AVOptions are per-stream, and thus a stream specifier should be attached to them:

ffmpeg -i multichannel.mxf -map 0:v:0 -map 0:a:0 -map 0:a:0 -c:a:0 ac3 -b:a:0 640k -ac:a:1 2 -c:a:1 aac -b:2 128k out.mp4

In the above example, a multichannel audio stream is mapped twice for output. The first instance is encoded with codec ac3 and bitrate 640k. The second instance is downmixed to 2 channels and encoded with codec aac. A bitrate of 128k is specified for it using absolute index of the output stream.

โš ๏ธ Note: the -nooption syntax cannot be used for boolean AVOptions, use -option 0/-option 1.
โš ๏ธ Note: the old undocumented way of specifying per-stream AVOptions by prepending v/a/s to the options name is now obsolete and will be removed soon.

๐ŸŒŸ Main options ๐ŸŒŸ

  • -f fmt (input/output) โ€” Force input or output file format. The format is normally auto detected for input files and guessed from the file extension for output files, so this option is not needed in most cases.
  • -i url (input) โ€” input file url.
  • -y (global) โ€” Overwrite output files without asking.
  • -n (global) โ€” Do not overwrite output files, and exit immediately if a specified output file already exists.
  • -stream_loop number (input) โ€” Set number of times input stream shall be looped. Loop 0 means no loop, loop -1 means infinite loop.
  • -recast_media (global) โ€” Allow forcing a decoder of a different media type than the one detected or designated by the demuxer. Useful for decoding media data muxed as data streams.
  • -c[:stream_specifier] codec (input/output,per-stream) and -codec[:stream_specifier] codec (input/output,per-stream) โ€” Select an encoder (when used before an output file) or a decoder (when used before an input file) for one or more streams. codec is the name of a decoder/encoder or a special value copy (output only) to indicate that the stream is not to be re-encoded.

For example:

ffmpeg -i INPUT -map 0 -c:v libx264 -c:a copy OUTPUT

encodes all video streams with libx264 and copies all audio streams.

For each stream, the last matching c option is applied, so:

ffmpeg -i INPUT -map 0 -c copy -c:v:1 libx264 -c:a:137 libvorbis OUTPUT

will copy all the streams except the second video, which will be encoded with libx264, and the 138th audio, which will be encoded with libvorbis.

  • -t duration (input/output) โ€” When used as an input option (before -i), limit the duration of data read from the input file.

When used as an output option (before an output url), stop writing the output after its duration reaches duration.

duration must be a time duration specification, see the Time duration section in the ffmpeg-utils(1) manual.

-to and -t are mutually exclusive and -t has priority.

  • -to position (input/output) โ€” Stop writing the output or reading the input at position. position must be a time duration specification, see the Time duration section in the ffmpeg-utils(1) manual.

-to and -t are mutually exclusive and -t has priority.

  • -fs limit_size (output) โ€” Set the file size limit, expressed in bytes. No further chunk of bytes is written after the limit is exceeded. The size of the output file is slightly more than the requested file size.
  • -ss position (input/output) โ€” When used as an input option (before -i), seeks in this input file to position. Note that in most formats it is not possible to seek exactly, so ffmpeg will seek to the closest seek point before position. When transcoding and -accurate_seek is enabled (the default), this extra segment between the seek point and position will be decoded and discarded. When doing stream copy or when -noaccurate_seek is used, it will be preserved.

When used as an output option (before an output url), decodes but discards input until the timestamps reach position.

position must be a time duration specification, see the Time duration section in the ffmpeg-utils(1) manual.

  • -sseof position (input) โ€” Like the -ss option but relative to the "end of file". That is negative values are earlier in the file, 0 is at EOF.
  • -isync input_index (input) โ€” Assign an input as a sync source.

This will take the difference between the start times of the target and reference inputs and offset the timestamps of the target file by that difference. The source timestamps of the two inputs should derive from the same clock source for expected results. If copyts is set then start_at_zero must also be set. If either of the inputs has no starting timestamp then no sync adjustment is made.

Acceptable values are those that refer to a valid ffmpeg input index. If the sync reference is the target index itself or -1, then no adjustment is made to target timestamps. A sync reference may not itself be synced to any other input.

Default value is -1.

  • -itsoffset offset (input) โ€” Set the input time offset.

offset must be a time duration specification, see the Time duration section in the ffmpeg-utils(1) manual.

The offset is added to the timestamps of the input files. Specifying a positive offset means that the corresponding streams are delayed by the time duration specified in offset.

  • -itsscale scale (input,per-stream) โ€” Rescale input timestamps. scale should be a floating point number.
  • -timestamp date (output) โ€” Set the recording timestamp in the container.

date must be a date specification, see the Date section in the ffmpeg-utils(1) manual.

  • -metadata[:metadata_specifier] key=value (output,per-metadata) โ€” Set a metadata key/value pair.

An optional metadata_specifier may be given to set metadata on streams, chapters or programs. See -map_metadata documentation for details.

This option overrides metadata set with -map_metadata. It is also possible to delete metadata by using an empty value.

For example, for setting the title in the output file:

ffmpeg -i in.avi -metadata title="my title" out.flv

To set the language of the first audio stream:

ffmpeg -i INPUT -metadata:s:a:0 language=eng OUTPUT
  • -disposition[:stream_specifier] value (output,per-stream) โ€” Sets the disposition flags for a stream.

Default value: by default, all disposition flags are copied from the input stream, unless the output stream this option applies to is fed by a complex filtergraph โ€” in that case no disposition flags are set by default.

value is a sequence of disposition flags separated by + or -. A + prefix adds the given disposition, - removes it. If the first flag is also prefixed with + or -, the resulting disposition is the default value updated by value. If the first flag is not prefixed, the resulting disposition is value. It is also possible to clear the disposition by setting it to 0.

If no -disposition options were specified for an output file, ffmpeg will automatically set the 'default' disposition flag on the first stream of each type, when there are multiple streams of this type in the output file and no stream of that type is already marked as default.

The -dispositions option lists the known disposition flags.

For example, to make the second audio stream the default stream:

ffmpeg -i in.mkv -c copy -disposition:a:1 default out.mkv

To make the second subtitle stream the default stream and remove the default disposition from the first subtitle stream:

ffmpeg -i in.mkv -c copy -disposition:s:0 0 -disposition:s:1 default out.mkv

To add an embedded cover/thumbnail:

ffmpeg -i in.mp4 -i IMAGE -map 0 -map 1 -c copy -c:v:1 png -disposition:v:1 attached_pic out.mp4

okay so, more disposition recipes because flag surgery is a whole art form and we're not done yet ๐ŸŽ€

To add the original flag and yeet the comment flag off the first audio stream โ€” without removing any of its other disposition flags:

ffmpeg -i in.mkv -c copy -disposition:a:0 +original-comment out.mkv

To do the exact opposite โ€” drop original and add comment โ€” again without touching the stream's other disposition flags:

ffmpeg -i in.mkv -c copy -disposition:a:0 -original+comment out.mkv

To set only original and comment on the first audio stream, and wipe all its other disposition flags (no + or - prefix means full replace, no cap, periodt):

ffmpeg -i in.mkv -c copy -disposition:a:0 original+comment out.mkv

To remove every single disposition flag from the first audio stream:

ffmpeg -i in.mkv -c copy -disposition:a:0 0 out.mkv
โš ๏ธ real talk: not all muxers support embedded thumbnails, and the ones that do only support a few formats, like JPEG or PNG. So if your container ghosts you, that's why ๐Ÿ’€

๐ŸŽ€ -program

[title=title:][program_num=program_num:]st=stream[:st=stream...]

(output) โ€” this one creates a program with the title you gave it and the program_num you gave it, then adds the specified stream(s) to it. Cute, tidy, done. โœจ

๐Ÿฆ‹ -stream_group

[map=input_file_id=stream_group][type=type:]st=stream[:st=stream][:stg=stream_group][:id=stream_group_id...]

(output) โ€” creates a stream group of the type and stream_group_id you asked for, or makes one by mapping an input group, and adds the specified stream(s) and/or previously defined stream_group(s) to it. Very main character energy, honestly.

type can be one of these:

iamf_audio_element โ€” groups the streams that belong to the same IAMF Audio Element.

For this group type, these options are available:

  • audio_element_type โ€” the Audio Element type. Supported values:
    • channel โ€” scalable channel audio representation
    • scene โ€” ambisonics representation
  • demixing โ€” demixing information used to reconstruct a scalable channel audio representation. This option must be separated from the rest with a ,, and takes these key=value options:
    • parameter_id โ€” an identifier that parameters blocks in frames may refer to
    • dmixp_mode โ€” a pre-defined combination of demixing parameters
  • recon_gain โ€” recon gain information used to reconstruct a scalable channel audio representation. This option must be separated from the rest with a ,, and takes these key=value options:
    • parameter_id โ€” an identifier that parameters blocks in frames may refer to
  • layer โ€” a layer defining a Channel Layout in the Audio Element. This option must be separated from the rest with a ,. Several ,-separated entries can be defined, and at least one must be set. It takes these :-separated key=value options:
    • ch_layout โ€” the layer's channel layout
    • flags โ€” the available flags are:
      • recon_gain โ€” whether to signal if recon_gain is present as metadata in parameter blocks within frames
    • output_gain
    • output_gain_flags โ€” which channels output_gain applies to. These flags are available: FL, FR, BL, BR, TFL, TFR
    • ambisonics_mode โ€” the ambisonics mode. This has no effect if audio_element_type is set to channel. Supported values:
      • mono โ€” each ambisonics channel is coded as an individual mono stream in the group
  • default_w โ€” default weight value

iamf_mix_presentation โ€” groups the streams that belong to all IAMF Audio Elements that the same IAMF Mix Presentation references.

For this group type, these options are available:

  • submix โ€” a sub-mix within the Mix Presentation. This option must be separated from the rest with a ,. Several ,-separated entries can be defined, and at least one must be set. It takes these :-separated key=value options:
    • parameter_id โ€” an identifier that parameters blocks in frames may refer to, for post-processing the mixed audio signal to generate the audio signal for playback
    • parameter_rate โ€” the sample rate duration fields in parameters blocks in frames that refer to this parameter_id are expressed as
    • default_mix_gain โ€” default mix gain value to apply when there are no parameter blocks sharing the same parameter_id for a given frame
    • element โ€” references an Audio Element used in this Mix Presentation to generate the final output audio signal for playback. This option must be separated from the rest with a |. Several |-separated entries can be defined, and at least one must be set. It takes these :-separated key=value options:
      • stg โ€” the stream_group_id for an Audio Element which this sub-mix refers to
      • parameter_id โ€” an identifier that parameters blocks in frames may refer to, for applying any processing to the referenced and rendered Audio Element before it gets summed with other processed Audio Elements
      • parameter_rate โ€” the sample rate duration fields in parameters blocks in frames that refer to this parameter_id are expressed as
      • default_mix_gain โ€” default mix gain value to apply when there are no parameter blocks sharing the same parameter_id for a given frame
      • annotations โ€” a key=value string describing the sub-mix element, where "key" is a string conforming to BCP-47 that specifies the language for the "value" string. "key" must be the same as the one in the mix's annotations
      • headphones_rendering_mode โ€” indicates whether the input channel-based Audio Element is rendered to stereo loudspeakers or spatialized with a binaural renderer when played back on headphones. This has no effect if the referenced Audio Element's audio_element_type is set to channel. Supported values:
        • stereo
        • binaural
    • layout โ€” specifies the layouts for this sub-mix on which the loudness information was measured. This option must be separated from the rest with a |. Several |-separated entries can be defined, and at least one must be set. It takes these :-separated key=value options:
      • layout_type
        • loudspeakers โ€” the layout follows the loudspeaker sound system convention of ITU-2051-3
        • binaural โ€” the layout is binaural
      • sound_system โ€” channel layout matching one of Sound Systems A to J of ITU-2051-3, plus 7.1.2 and 3.1.2. This has no effect if layout_type is set to binaural
      • integrated_loudness โ€” the program integrated loudness information, as defined in ITU-1770-4
      • digital_peak โ€” the digital (sampled) peak value of the audio signal, as defined in ITU-1770-4
      • true_peak โ€” the true peak of the audio signal, as defined in ITU-1770-4
      • dialog_anchored_loudness โ€” the Dialogue loudness information, as defined in ITU-1770-4
      • album_anchored_loudness โ€” the Album loudness information, as defined in ITU-1770-4
  • annotations โ€” a key=value string describing the mix, where "key" is a string conforming to BCP-47 that specifies the language for the "value" string. "key" must be the same as the ones in all sub-mix element's annotations

E.g. to create a scalable 5.1 IAMF file from several WAV input files ๐ŸŒˆ

ffmpeg -i front.wav -i back.wav -i center.wav -i lfe.wav
-map 0:0 -map 1:0 -map 2:0 -map 3:0 -c:a opus
-stream_group type=iamf_audio_element:id=1:st=0:st=1:st=2:st=3,
demixing=parameter_id=998,
recon_gain=parameter_id=101,
layer=ch_layout=stereo,
layer=ch_layout=5.1(side),
-stream_group type=iamf_mix_presentation:id=2:stg=0:annotations=en-us=Mix_Presentation,
submix=parameter_id=100:parameter_rate=48000|element=stg=0:parameter_id=100:annotations=en-us=Scalable_Submix|layout=sound_system=stereo|layout=sound_system=5.1(side)
-streamid 0:0 -streamid 1:1 -streamid 2:2 -streamid 3:3 output.iamf

To copy the two stream groups (Audio Element and Mix Presentation) from an input IAMF file with four streams into an mp4 output:

ffmpeg -i input.iamf -c:a copy -stream_group map=0=0:st=0:st=1:st=2:st=3 -stream_group map=0=1:stg=0
-streamid 0:0 -streamid 1:1 -streamid 2:2 -streamid 3:3 output.mp4

๐Ÿ’œ -target type (output)

Specify the target file type: vcd, svcd, dvd, dv, dv50. type may be prefixed with pal-, ntsc- or film- to use the corresponding standard. All the format options (bitrate, codecs, buffer sizes) then get set automatically for you, which is honestly such a slay. You can just type:

ffmpeg -i myfile.avi -target vcd /tmp/vcd.mpg

Nevertheless, you can specify additional options as long as you know they do not conflict with the standard, as in:

ffmpeg -i myfile.avi -target vcd -bf 2 /tmp/vcd.mpg

so like, the parameters that get set for each -target are literally these, bestie โ€” copying them exactly because no cap, they matter ๐Ÿ‘‡

VCD

<pal>:

-f vcd -muxrate 1411200 -muxpreload 0.44 -packetsize 2324
-s 352x288 -r 25
-codec:v mpeg1video -g 15 -b:v 1150k -maxrate:v 1150k -minrate:v 1150k -bufsize:v 327680
-ar 44100 -ac 2
-codec:a mp2 -b:a 224k

<ntsc>:

-f vcd -muxrate 1411200 -muxpreload 0.44 -packetsize 2324
-s 352x240 -r 30000/1001
-codec:v mpeg1video -g 18 -b:v 1150k -maxrate:v 1150k -minrate:v 1150k -bufsize:v 327680
-ar 44100 -ac 2
-codec:a mp2 -b:a 224k

<film>:

-f vcd -muxrate 1411200 -muxpreload 0.44 -packetsize 2324
-s 352x240 -r 24000/1001
-codec:v mpeg1video -g 18 -b:v 1150k -maxrate:v 1150k -minrate:v 1150k -bufsize:v 327680
-ar 44100 -ac 2
-codec:a mp2 -b:a 224k

SVCD

<pal>:

-f svcd -packetsize 2324
-s 480x576 -pix_fmt yuv420p -r 25
-codec:v mpeg2video -g 15 -b:v 2040k -maxrate:v 2516k -minrate:v 0 -bufsize:v 1835008 -scan_offset 1
-ar 44100
-codec:a mp2 -b:a 224k

<ntsc>:

-f svcd -packetsize 2324
-s 480x480 -pix_fmt yuv420p -r 30000/1001
-codec:v mpeg2video -g 18 -b:v 2040k -maxrate:v 2516k -minrate:v 0 -bufsize:v 1835008 -scan_offset 1
-ar 44100
-codec:a mp2 -b:a 224k

<film>:

-f svcd -packetsize 2324
-s 480x480 -pix_fmt yuv420p -r 24000/1001
-codec:v mpeg2video -g 18 -b:v 2040k -maxrate:v 2516k -minrate:v 0 -bufsize:v 1835008 -scan_offset 1
-ar 44100
-codec:a mp2 -b:a 224k

DVD

<pal>:

-f dvd -muxrate 10080k -packetsize 2048
-s 720x576 -pix_fmt yuv420p -r 25
-codec:v mpeg2video -g 15 -b:v 6000k -maxrate:v 9000k -minrate:v 0 -bufsize:v 1835008
-ar 48000
-codec:a ac3 -b:a 448k

<ntsc>:

-f dvd -muxrate 10080k -packetsize 2048
-s 720x480 -pix_fmt yuv420p -r 30000/1001
-codec:v mpeg2video -g 18 -b:v 6000k -maxrate:v 9000k -minrate:v 0 -bufsize:v 1835008
-ar 48000
-codec:a ac3 -b:a 448k

<film>:

-f dvd -muxrate 10080k -packetsize 2048
-s 720x480 -pix_fmt yuv420p -r 24000/1001
-codec:v mpeg2video -g 18 -b:v 6000k -maxrate:v 9000k -minrate:v 0 -bufsize:v 1835008
-ar 48000
-codec:a ac3 -b:a 448k

DV

<pal>:

-f dv
-s 720x576 -pix_fmt yuv420p -r 25
-ar 48000 -ac 2

<ntsc>:

-f dv
-s 720x480 -pix_fmt yuv411p -r 30000/1001
-ar 48000 -ac 2

<film>:

-f dv
-s 720x480 -pix_fmt yuv411p -r 24000/1001
-ar 48000 -ac 2

okay and the dv50 target is literally identical to the dv target, except the pixel format it sets is yuv422p for all three standards. slay ๐Ÿซถ

๐Ÿ’… lowkey important: any value you set for a parameter up there will override the target preset value. in that case, your output may not comply with the target standard. don't say i didn't warn you.

  • -dn (input/output) โ€” as an input option, it blocks all data streams of a file from being filtered or being automatically selected or mapped for any output. see the -discard option if you wanna disable streams individually instead. as an output option, it disables data recording, i.e. automatic selection or mapping of any data stream. want full manual control? see the -map option. ๐Ÿ’–
  • -dframes number (output) โ€” sets the number of data frames to output. it's an obsolete alias for -frames:d, which you should use instead (fr fr, use the new one).
  • -frames[:stream_specifier] framecount (output,per-stream) โ€” stops writing to the stream after framecount frames. bye bestie ๐Ÿ‘‹
  • -q[:stream_specifier] q (output,per-stream)
  • -qscale[:stream_specifier] q (output,per-stream) โ€” use a fixed quality scale (VBR). the meaning of q/qscale is codec-dependent, so like... it depends. if qscale is used without a stream_specifier, then it applies only to the video stream โ€” this is to keep compatibility with previous behaviour, and because specifying the same codec-specific value to 2 different codecs (that's audio and video) generally is not what is intended when no stream_specifier is used. iykyk ๐ŸŽ€
  • -filter[:stream_specifier] filtergraph (output,per-stream) โ€” creates the filtergraph specified by filtergraph and uses it to filter the stream. filtergraph is a description of the filtergraph to apply to the stream, and must have a single input and a single output of the same type of the stream. inside the filtergraph, the input gets associated with the label in, and the output with the label out. see the ffmpeg-filters manual for more tea about the filtergraph syntax โ˜• if you want filtergraphs with multiple inputs and/or outputs, check out the -filter_complex option instead.
  • -reinit_filter[:stream_specifier] integer (input,per-stream) โ€” this boolean option decides if the filtergraph(s) that this stream gets fed into get reinitialized when input frame parameters change mid-stream. it's enabled by default, because most video filters and all audio filters cannot handle deviation in input frame properties. ngl when reinitialization happens, existing filter state is lost โ€” like e.g. the frame count n reference available in some filters. any frames buffered at the time of reinitialization are lost too ๐Ÿ˜ญ the properties where a change triggers reinitialization are: for video, frame resolution or pixel format; for audio, sample format, sample rate, channel count or channel layout.
  • -drop_changed[:stream_specifier] integer (input,per-stream) โ€” this boolean option decides whether a frame with differing frame parameters mid-stream gets dropped instead of leading to filtergraph reinitialization (which would, as established, lead to loss of filter state). generally useful to avoid corrupted yet decodable packets in live streaming inputs. default is false. ๐Ÿ™ˆ
  • -filter_threads nb_threads (global) โ€” defines how many threads are used to process a filter pipeline. each pipeline will produce a thread pool with this many threads available for parallel processing. the default is the number of available CPUs. multitasking queen ๐Ÿ‘‘
  • -filter_buffered_frames nb_frames (global) โ€” defines the maximum number of buffered frames allowed in a filtergraph. under normal circumstances a filtergraph shouldn't buffer more than a few frames, especially if frames are being fed to it and read from it in a balanced way (which is the intended behavior in ffmpeg). that said, this option lets you limit the total number of frames buffered across all links in a filtergraph. if more frames are generated, filtering is aborted and an error is returned. the default value is 0, which means no limit. โœจ
  • -pre[:stream_specifier] preset_name (output,per-stream) โ€” specify the preset for matching stream(s). simple as that, bestie.
  • -stats (global) โ€” log encoding progress/statistics as info-level log (see -loglevel). it's on by default, so to explicitly disable it you need to specify -nostats. ๐ŸŽ€
  • -stats_period time (global) โ€” sets the period at which encoding progress/statistics get updated. default is 0.5 seconds. tick tock โฐ
  • -print_graphs (global) โ€” prints execution graph details to stderr, in the format set via -print_graphs_format.
  • -print_graphs_file filename (global) โ€” writes execution graph details to the specified file, in the format set via -print_graphs_format.
  • -print_graphs_format format (global) โ€” sets the output format. available formats are: default, compact, csv, flat, ini, json, xml, mermaid, mermaidhtml. the default format is json. so many choices, main character energy ๐ŸŒˆ
  • -progress url (global) โ€” sends program-friendly progress information to url. progress info is written periodically and at the end of the encoding process. it's made of key=value lines. key consists of only alphanumeric characters. the last key of a sequence of progress information is always progress with the value continue or end. the update period is set using -stats_period. for example, log progress information to stdout:
ffmpeg -progress pipe:1 -i in.mkv out.mkv
  • -stdin โ€” enables interaction on standard input. it's on by default unless standard input is used as an input. to explicitly disable interaction you need to specify -nostdin. disabling interaction on standard input is useful, for example, if ffmpeg is in the background process group. roughly the same result can be achieved with ffmpeg ... < /dev/null but that requires a shell. ๐Ÿ’…
  • -debug_ts (global) โ€” prints timestamp/latency information. it's off by default. this option is mostly useful for testing and debugging purposes, and the output format may change from one version to another, so it should not be employed by portable scripts. see also the option -fdebug ts. โš ๏ธ no cap, don't build scripts on this.
  • -attach filename (output) โ€” adds an attachment to the output file. this is supported by a few formats like Matroska, for e.g. fonts used in rendering subtitles. attachments are implemented as a specific type of stream, so this option will add a new stream to the file. it's then possible to use per-stream options on this stream in the usual way. attachment streams created with this option will be created after all the other streams (i.e. those created with -map or automatic mappings). note that for Matroska you also have to set the mimetype metadata tag:
ffmpeg -i INPUT -attach DejaVuSans.ttf -metadata:s:2 mimetype=application/x-truetype-font out.mkv

(assuming that the attachment stream will be third in the output file) ๐Ÿฆ‹

  • -dump_attachment[:stream_specifier] filename (input,per-stream) โ€” extracts the matching attachment stream into a file named filename. if filename is empty, then the value of the filename metadata tag will be used. e.g. to extract the first attachment to a file named out.ttf:
ffmpeg -dump_attachment:t:0 out.ttf -i INPUT

to extract all attachments to files determined by the filename tag:

ffmpeg -dump_attachment:t "" -i INPUT
Technical note โ€” attachments are implemented as codec extradata, so this option can actually be used to extract extradata from any stream, not just attachments. ๐Ÿ’…

๐ŸŽฅ Video Options

Okay bestie, video time. These are the knobs for the moving pictures. ๐ŸŽฌ

  • -vframes number (output) โ€” Set the number of video frames to output. This one is an obsolete alias for -frames:v, and you should use that instead, fr fr.
  • -r[:stream_specifier] fps (input/output, per-stream) โ€” Set frame rate (Hz value, fraction or abbreviation).

As an input option: ignore any timestamps stored in the file and instead generate timestamps assuming constant frame rate fps. This is not the same as the -framerate option used for some input formats like image2 or v4l2 (it used to be the same in older versions of FFmpeg). If in doubt, use -framerate instead of the input option -r.

As an output option:

  • video encoding โ€” Duplicate or drop frames right before encoding them to achieve constant output frame rate fps.
  • video streamcopy โ€” Indicate to the muxer that fps is the stream frame rate. No data is dropped or duplicated in this case. This may produce invalid files if fps does not match the actual stream frame rate as determined by packet timestamps. See also the setts bitstream filter.
  • -fpsmax[:stream_specifier] fps (output, per-stream) โ€” Set maximum frame rate (Hz value, fraction or abbreviation).

Clamps output frame rate when output framerate is auto-set and is higher than this value. Useful in batch processing or when input framerate is wrongly detected as very high. It cannot be set together with -r. It is ignored during streamcopy.

  • -s[:stream_specifier] size (input/output, per-stream) โ€” Set frame size.

As an input option, this is a shortcut for the video_size private option, recognized by some demuxers for which the frame size is either not stored in the file or is configurable โ€” e.g. raw video or video grabbers.

As an output option, this inserts the scale video filter to the end of the corresponding filtergraph. Please use the scale filter directly to insert it at the beginning or some other place.

The format is wxh (default - same as source).

  • -aspect[:stream_specifier] aspect (output, per-stream) โ€” Set the video display aspect ratio specified by aspect.

aspect can be a floating point number string, or a string of the form num:den, where num and den are the numerator and denominator of the aspect ratio. For example "4:3", "16:9", "1.3333", and "1.7777" are valid argument values.

If used together with -vcodec copy, it will affect the aspect ratio stored at container level, but not the aspect ratio stored in encoded frames, if it exists.

  • -display_rotation[:stream_specifier] rotation (input, per-stream) โ€” Set video rotation metadata.

rotation is a decimal number specifying the amount in degree by which the video should be rotated counter-clockwise before being displayed.

This option overrides the rotation/display transform metadata stored in the file, if any. When the video is being transcoded (rather than copied) and -autorotate is enabled, the video will be rotated at the filtering stage. Otherwise, the metadata will be written into the output file if the muxer supports it.

If the -display_hflip and/or -display_vflip options are given, they are applied after the rotation specified by this option.

  • -display_hflip[:stream_specifier] (input, per-stream) โ€” Set whether on display the image should be horizontally flipped.

See the -display_rotation option for more details.

  • -display_vflip[:stream_specifier] (input, per-stream) โ€” Set whether on display the image should be vertically flipped.

See the -display_rotation option for more details.

  • -vn (input/output) โ€” As an input option, blocks all video streams of a file from being filtered or being automatically selected or mapped for any output. See -discard option to disable streams individually.

As an output option, disables video recording i.e. automatic selection or mapping of any video stream. For full manual control see the -map option.

  • -vcodec codec (output) โ€” Set the video codec. This is an alias for -codec:v. Slay.
  • -pass[:stream_specifier] n (output, per-stream) โ€” Select the pass number (1 or 2). It is used to do two-pass video encoding. The statistics of the video are recorded in the first pass into a log file (see also the option -passlogfile), and in the second pass that log file is used to generate the video at the exact requested bitrate. On pass 1, you may just deactivate audio and set output to null, examples for Windows and Unix:
ffmpeg -i foo.mov -c:v libxvid -pass 1 -an -f rawvideo -y NUL
ffmpeg -i foo.mov -c:v libxvid -pass 1 -an -f rawvideo -y /dev/null
  • -passlogfile[:stream_specifier] prefix (output, per-stream) โ€” Set two-pass log file name prefix to prefix, the default file name prefix is ffmpeg2pass. The complete file name will be PREFIX-N.log, where N is a number specific to the output stream.
  • -vf filtergraph (output) โ€” Create the filtergraph specified by filtergraph and use it to filter the stream.

This is an alias for -filter:v, see the -filter option.

  • -autorotate โ€” Automatically rotate the video according to file metadata. Enabled by default, use -noautorotate to disable it.
  • -autoscale โ€” Automatically scale the video according to the resolution of first frame. Enabled by default, use -noautoscale to disable it. When autoscale is disabled, all output frames of filter graph might not be in the same resolution and may be inadequate for some encoder/muxer. Therefore, it is not recommended to disable it unless you really know what you are doing. Disable autoscale at your own risk. ๐Ÿ˜ญ

๐Ÿš€ Advanced Video options

These are the deeper cuts. Still iconic, just a little more niche. โœจ

  • -pix_fmt[:stream_specifier] format (input/output, per-stream) โ€” Set pixel format. Use -pix_fmts to show all the supported pixel formats. If the selected pixel format can not be selected, ffmpeg will print a warning and select the best pixel format supported by the encoder. If pix_fmt is prefixed by a +, ffmpeg will exit with an error if the requested pixel format can not be selected, and automatic conversions inside filtergraphs are disabled. If pix_fmt is a single +, ffmpeg selects the same pixel format as the input (or graph output) and automatic conversions are disabled.
  • -sws_flags flags (input/output) โ€” Set default flags for the libswscale library. These flags are used by automatically inserted scale filters and those within simple filtergraphs, if not overridden within the filtergraph definition.

See the ffmpeg-scaler manual for a list of scaler options.

  • -rc_override[:stream_specifier] override (output, per-stream) โ€” Rate control override for specific intervals, formatted as int,int,int list separated with slashes. Two first values are the beginning and end frame numbers, last one is quantizer to use if positive, or quality factor if negative.
  • -vstats โ€” Dump video coding statistics to vstats_HHMMSS.log. See the vstats file format section for the format description.
  • -vstats_file file โ€” Dump video coding statistics to file. See the vstats file format section for the format description.
  • -vstats_version file โ€” Specify which version of the vstats format to use. Default is 2. See the vstats file format section for the format description.
  • -vtag fourcc/tag (output) โ€” Force video tag/fourcc. This is an alias for -tag:v.
  • -force_key_frames[:stream_specifier] (output, per-stream) โ€” force_key_frames can take arguments of the following form: time[,time...], expr:expr, source, or scd_metadata.

Full signatures as listed:

-force_key_frames[:stream_specifier] time[,time...]
-force_key_frames[:stream_specifier] expr:expr
-force_key_frames[:stream_specifier] source
-force_key_frames[:stream_specifier] scd_metadata
  • time[,time...] โ€” If the argument consists of timestamps, ffmpeg will round the specified times to the nearest output timestamp as per the encoder time base and force a keyframe at the first frame having timestamp equal or greater than the computed timestamp. Note that if the encoder time base is too coarse, then the keyframes may be forced on frames with timestamps lower than the specified time. The default encoder time base is the inverse of the output framerate but may be set otherwise via -enc_time_base.

If one of the times is ""chapters"[delta]", it is expanded into the time of the beginning of all chapters in the file, shifted by delta, expressed as a time in seconds. This option can be useful to ensure that a seek point is present at a chapter mark or any other designated place in the output file.

For example, to insert a key frame at 5 minutes, plus key frames 0.1 second before the beginning of every chapter:

-force_key_frames 0:05:00,chapters-0.1
  • expr:expr โ€” If the argument is prefixed with expr:, the string expr is interpreted like an expression and is evaluated for each frame. A key frame is forced in case the evaluation is non-zero.

The expression in expr can contain the following constants:

  • n โ€” the number of current processed frame, starting from 0
  • n_forced โ€” the number of forced frames
  • prev_forced_n โ€” the number of the previous forced frame, it is NAN when no keyframe was forced yet
  • prev_forced_t โ€” the time of the previous forced frame, it is NAN when no keyframe was forced yet
  • t โ€” the time of the current processed frame

For example to force a key frame every 5 seconds, you can specify:

-force_key_frames expr:gte(t,n_forced*5)

To force a key frame 5 seconds after the time of the last forced one, starting from second 13:

-force_key_frames expr:if(isnan(prev_forced_t),gte(t,13),gte(t,prev_forced_t+5))
  • source โ€” If the argument is source, ffmpeg will force a key frame if the current frame being encoded is marked as a key frame in its source. In cases where this particular source frame has to be dropped, enforce the next available frame to become a key frame instead.
  • scd_metadata โ€” if the argument is literally "scd_metadata", ffmpeg forces a key frame whenever the current frame carries a metadata entry whose key is "lavfi.scd.time". That metadata gets dropped in by filters like scdet and scdet_vulkan ๐Ÿ’…. Pro tip: don't put frame-duplicating filters after scdet โ€” you'll end up with duplicate metadata on multiple frames and key frames getting inserted over and over, which is giving chaos honestly ๐Ÿ˜ญ.
ngl, forcing way too many keyframes is genuinely harmful to the lookahead algorithms some encoders use โ€” you're better off with fixed-GOP options or something similar, fr fr.

  • -apply_cropping[:stream_specifier] source (input,per-stream) โ€” auto-crops the video after decoding, following whatever cropping metadata the file says ๐ŸŒธ. Default is all.
    • none (0) โ€” don't apply any cropping metadata at all, leave it be.
    • all (1) โ€” apply both codec- and container-level croppping. This is the default mode, the main character โœจ.
    • codec (2) โ€” apply codec level croppping only.
    • container (3) โ€” apply container level croppping only.
  • -copyinkf[:stream_specifier] (output,per-stream) โ€” when you're stream copying, also copy the non-key frames chillin' at the beginning ๐Ÿซถ.

๐Ÿงš hw device stuff (the hardware era)

  • -init_hw_device type[=name][:device[,key=value...]] โ€” boot up a brand-new hardware device of type type called name, using the device parameters you hand it ๐Ÿ”ฅ. If you don't give a name, it gets a default one shaped like type%d.

The meaning of device and everything after it depends on the device type, so buckle up bestie:

  • cuda โ€” device is the number of the CUDA device. Recognised options:
    • primary_ctx โ€” if set to 1, uses the primary device context instead of creating a new one.
    • Examples:
      • -init_hw_device cuda:1 โ€” choose the second device on the system.
      • -init_hw_device cuda:0,primary_ctx=1 โ€” choose the first device and use the primary device context.
  • dxva2 โ€” device is the number of the Direct3D 9 display adapter.
  • d3d11va โ€” device is the number of the Direct3D 11 display adapter. If you don't specify it, it attempts to use the default Direct3D 11 display adapter, or the first Direct3D 11 display adapter whose hardware VendorId is specified by vendor_id.
    • Examples:
      • -init_hw_device d3d11va โ€” create a d3d11va device on the default Direct3D 11 display adapter.
      • -init_hw_device d3d11va:1 โ€” create a d3d11va device on the Direct3D 11 display adapter specified by index 1.
      • -init_hw_device d3d11va:,vendor_id=0x8086 โ€” create a d3d11va device on the first Direct3D 11 display adapter whose hardware VendorId is 0x8086.
  • vaapi โ€” device is either an X11 display name, a DRM render node, or a DirectX adapter index ๐Ÿ‘‘. If it's not specified, it attempts to open the default X11 display ($DISPLAY) and then the first DRM render node (/dev/dri/renderD128), or the default DirectX adapter on Windows. Recognised options:
    • kernel_driver โ€” when device isn't specified, use this to name the kernel driver associated with the device you want. Only available when the hardware acceleration methods drm and vaapi are enabled.
    • vendor_id โ€” when device and kernel_driver aren't specified, use this to set the vendor id associated with the device you want. Only available when the hardware acceleration methods drm and vaapi are enabled and kernel_driver isn't specified.
    • Examples:
      • -init_hw_device vaapi โ€” create a vaapi device on the default device.
      • -init_hw_device vaapi:/dev/dri/renderD129 โ€” create a vaapi device on DRM render node /dev/dri/renderD129.
      • -init_hw_device vaapi:1 โ€” create a vaapi device on DirectX adapter 1.
      • -init_hw_device vaapi:,kernel_driver=i915 โ€” create a vaapi device on a device associated with kernel driver i915.
      • -init_hw_device vaapi:,vendor_id=0x8086 โ€” create a vaapi device on a device associated with vendor id 0x8086.
  • vdpau โ€” device is an X11 display name. If it's not specified, it attempts to open the default X11 display ($DISPLAY).
  • qsv โ€” device selects a value in MFX_IMPL_*. Allowed values are: auto, sw, hw, auto_any, hw_any, hw2, hw3, hw4. If not specified, auto_any is used ๐Ÿ’€ (tho ngl, it may be easier to get what you want out of QSV by creating the platform-appropriate subdevice โ€” dxva2 or d3d11va or vaapi โ€” and then deriving a QSV device from that). Recognised options:
    • child_device โ€” specify a DRM render node on Linux or a DirectX adapter on Windows.
    • child_device_type โ€” choose a platform-appropriate subdevice type. On Windows, d3d11va is the default subdevice type when --enable-libvpl is specified at configuration time, and dxva2 is the default subdevice type when --enable-libmfx is specified at configuration time. On Linux you can only use vaapi as the subdevice type.
    • Examples:
      • -init_hw_device qsv:hw,child_device=/dev/dri/renderD129 โ€” create a QSV device with MFX_IMPL_HARDWARE on DRM render node /dev/dri/renderD129.
      • -init_hw_device qsv:hw,child_device=1 โ€” create a QSV device with MFX_IMPL_HARDWARE on DirectX adapter 1.
      • -init_hw_device qsv:hw,child_device_type=d3d11va โ€” choose the GPU subdevice with type d3d11va and create a QSV device with MFX_IMPL_HARDWARE.
      • -init_hw_device qsv:hw,child_device_type=dxva2 โ€” choose the GPU subdevice with type dxva2 and create a QSV device with MFX_IMPL_HARDWARE.
      • -init_hw_device qsv:hw,child_device=1,child_device_type=d3d11va โ€” create a QSV device with MFX_IMPL_HARDWARE on DirectX adapter 1 with subdevice type d3d11va.
      • -init_hw_device vaapi=va:/dev/dri/renderD129 -init_hw_device qsv=hw1@va โ€” create a VAAPI device called va on /dev/dri/renderD129, then derive a QSV device called hw1 from the device va. slay ๐ŸŒˆ
  • opencl โ€” device selects the platform and device as platform_index.device_index. You can also filter the set of devices using key-value pairs to find only devices matching particular platform or device strings. The strings usable as filters are: platform_profile, platform_version, platform_name, platform_vendor, platform_extensions, device_name, device_vendor, driver_version, device_version, device_profile, device_extensions, device_type. The indices and filters must together uniquely select a device โ€” no ambiguity allowed bestie โœจ.
    • Examples:
      • -init_hw_device opencl:0.1 โ€” choose the second device on the first platform.
      • -init_hw_device opencl:,device_name=Foo9000 โ€” choose the device with a name containing the string Foo9000.
      • -init_hw_device opencl:1,device_type=gpu,device_extensions=cl_khr_fp16 โ€” choose the GPU device on the second platform supporting the cl_khr_fp16 extension.
  • vulkan โ€” if device is an integer, it selects the device by its index in a system-dependent list of devices. If device is any other string, it selects the first device with a name containing that string as a substring ๐Ÿฆ‹. Recognised options:
    • debug โ€” if set to 1, enables the validation layer, if it's installed.
    • linear_images โ€” if set to 1, images allocated by the hwcontext will be linear and locally mappable.
    • instance_extensions โ€” a plus-separated list of additional instance extensions to enable.
    • device_extensions โ€” a plus-separated list of additional device extensions to enable.
    • Examples:
      • -init_hw_device vulkan:1 โ€” choose the second device on the system.
      • -init_hw_device vulkan:RADV โ€” choose the first device with a name containing the string RADV.
      • -init_hw_device vulkan:0,instance_extensions=VK_KHR_wayland_surface+VK_KHR_xcb_surface โ€” choose the first device and enable the Wayland and XCB instance extensions.
  • -init_hw_device type[=name]@source โ€” initialise a new hardware device of type type called name, deriving it from the existing device with the name source ๐ŸŽ€.
  • -init_hw_device list โ€” list every hardware device type supported in this build of ffmpeg. Iconic, zero notes.
  • -filter_hw_device name โ€” pass the hardware device called name to all filters in any filter graph. Use it to set the device to upload to with the hwupload filter, or the device to map to with the hwmap filter ๐Ÿ’œ. Other filters may also use this parameter when they require a hardware device. Note that this is typically only required when the input isn't already in hardware frames โ€” when it is, filters just derive the device they need from the context of the frames they receive as input, iykyk. This is a global setting, so every filter receives the same device.
  • -hwaccel[:stream_specifier] hwaccel (input,per-stream) โ€” use hardware acceleration to decode the matching stream(s) โšก. The allowed values of hwaccel are:
    • none โ€” don't use any hardware acceleration (the default).
    • auto โ€” automatically select the hardware acceleration method.
    • vdpau โ€” use VDPAU (Video Decode and Presentation API for Unix) hardware acceleration.
    • dxva2 โ€” use DXVA2 (DirectX Video Acceleration) hardware acceleration.
    • d3d11va โ€” use D3D11VA (DirectX Video Acceleration) hardware acceleration.
    • vaapi โ€” use VAAPI (Video Acceleration API) hardware acceleration.
  • qsv โ€” use the Intel QuickSync Video acceleration for video transcoding. okay so heads up: unlike most other values, this one does not enable accelerated decoding (that happens automatically whenever a qsv decoder is selected) โ€” it's accelerated transcoding, without copying the frames into the system memory. For it to work, both the decoder and the encoder must support QSV acceleration and no filters must be used. ๐Ÿ’…
  • videotoolbox โ€” use Video Toolbox hardware acceleration.

This option has no effect if the selected hwaccel is not available or not supported by the chosen decoder.

bestie pls read this before you get your hopes up: most acceleration methods are intended for playback and will not be faster than software decoding on modern CPUs ๐Ÿ˜ญ. On top of that, ffmpeg will usually need to copy the decoded frames from the GPU memory into the system memory, which is even more performance loss. So likeโ€ฆ this option is mainly useful for testing. ngl, that's the whole tea. ๐Ÿซ–
  • -hwaccel_device[:stream_specifier] hwaccel_device (input,per-stream) โ€” pick a device to use for hardware acceleration. This option only makes sense when the -hwaccel option is also specified โœจ. It can either refer to an existing device created with -init_hw_device by name, or it can create a new device as if -init_hw_device type:hwaccel_device were called immediately before. cute, right? ๐ŸŽ€
  • -hwaccels โ€” list all hardware acceleration components enabled in this build of ffmpeg. lowkey important: actual runtime availability depends on the hardware and its suitable driver being installed. so like, being listed โ‰  actually working, yk? ๐Ÿ’€
  • -fix_sub_duration_heartbeat[:stream_specifier] โ€” set a specific output video stream as the heartbeat stream according to which to split and push through currently in-progress subtitle upon receipt of a random access packet. ๐Ÿซ€

This lowers the latency of subtitles for which the end packet or the following subtitle has not yet been received. As a drawback, this will most likely lead to duplication of subtitle events in order to cover the full duration, so when dealing with use cases where latency of when the subtitle event is passed on to output is not relevant, this option should not be utilized. read that again before you enable it fr fr ๐Ÿšจ

Requires -fix_sub_duration to be set for the relevant input subtitle stream for this to have any effect, as well as for the input subtitle stream having to be directly mapped to the same output in which the heartbeat stream resides. iykyk ๐Ÿ’œ


๐ŸŽง Audio Options ๐ŸŽง

  • -aframes number (output) โ€” set the number of audio frames to output. This is an obsolete alias for -frames:a, which you should use instead. obsolete means we're not doing that anymore bestie ๐Ÿ™ˆ
  • -ar[:stream_specifier] freq (input/output,per-stream) โ€” set the audio sampling frequency. For output streams it is set by default to the frequency of the corresponding input stream. For input streams this option only makes sense for audio grabbing devices and raw demuxers and is mapped to the corresponding demuxer options. ๐Ÿ”ฅ
  • -aq q (output) โ€” set the audio quality (codec-specific, VBR). This is an alias for -q:a. slay โœจ
  • -ac[:stream_specifier] channels (input/output,per-stream) โ€” set the number of audio channels. For output streams it is set by default to the number of input audio channels. For input streams this option only makes sense for audio grabbing devices and raw demuxers and is mapped to the corresponding demuxer options. ๐ŸŽ€
  • -an (input/output) โ€” okay so this one's got two moods ๐Ÿ’…:
    • As an input option, it blocks all audio streams of a file from being filtered or being automatically selected or mapped for any output. See the -discard option to disable streams individually.
    • As an output option, it disables audio recording โ€” i.e. automatic selection or mapping of any audio stream. For full manual control see the -map option. ๐Ÿ‘‘
  • -acodec codec (input/output) โ€” set the audio codec. This is an alias for -codec:a. โญ
  • -sample_fmt[:stream_specifier] sample_fmt (output,per-stream) โ€” set the audio sample format. Use -sample_fmts to get a list of supported sample formats. ๐ŸŒธ
  • -af filtergraph (output) โ€” create the filtergraph specified by filtergraph and use it to filter the stream. This is an alias for -filter:a, see the -filter option. ๐Ÿฆ‹

๐ŸŒŸ Advanced Audio options ๐ŸŒŸ

  • -atag fourcc/tag (output) โ€” force audio tag/fourcc. This is an alias for -tag:a. ๐Ÿ’–
  • -ch_layout[:stream_specifier] layout (input/output,per-stream) โ€” alias for -channel_layout. ๐ŸŽ€
  • -channel_layout[:stream_specifier] layout (input/output,per-stream) โ€” set the audio channel layout. For output streams it is set by default to the input channel layout. For input streams it overrides the channel layout of the input. noted: not all decoders respect the overridden channel layout ๐Ÿ‘€. This option also sets the channel layout for audio grabbing devices and raw demuxers and is mapped to the corresponding demuxer option. ๐ŸŒˆ
  • -guess_layout_max channels (input,per-stream) โ€” if some input channel layout is not known, try to guess only if it corresponds to at most the specified number of channels. For example, 2 tells to ffmpeg to recognize 1 channel as mono and 2 channels as stereo but not 6 channels as 5.1. The default is to always try to guess. Use 0 to disable all guessing. Using the -channel_layout option to explicitly specify an input layout also disables guessing. ๐Ÿ”ฎ

๐Ÿ“ Subtitle options ๐Ÿ“

  • -scodec codec (input/output) โ€” set the subtitle codec. This is an alias for -codec:s. ๐Ÿ’œ
  • -sn (input/output) โ€” again, two moods bestie ๐Ÿซถ:
    • As an input option, it blocks all subtitle streams of a file from being filtered or being automatically selected or mapped for any output. See -discard option to disable streams individually.
    • As an output option, it disables subtitle recording โ€” i.e. automatic selection or mapping of any subtitle stream. For full manual control see the -map option. โœจ

๐Ÿงš Advanced Subtitle options ๐Ÿงš

  • -fix_sub_duration โ€” fix subtitles durations. For each subtitle, wait for the next packet in the same stream and adjust the duration of the first to avoid overlap. This is necessary with some subtitles codecs, especially DVB subtitles, because the duration in the original packet is only a rough estimate and the end is actually marked by an empty subtitle frame. failing to use this option when necessary can result in exaggerated durations or muxing failures due to non-monotonic timestamps ๐Ÿ˜ญ๐Ÿ’€
โš ๏ธ real talk: this option will delay the output of all data until the next subtitle packet is decoded โ€” it may increase memory consumption and latency a lot. so like, don't just turn it on for fun ๐Ÿšจ
  • -canvas_size size โ€” set the size of the canvas used to render subtitles. ๐ŸŽจ

๐Ÿ‘‘ Advanced options ๐Ÿ‘‘

  • -map [-]input_file_id[:stream_specifier][:view_specifier][:?] | [linklabel] (output) โ€” create one or more streams in the output file. This option has two forms for specifying the data source(s): the first selects one or more streams from some input file (specified with -i), the second takes an output from some complex filtergraph (specified with -filter_complex). ๐ŸŒŸ

In the first form, an output stream is created for every stream from the input file with the index input_file_id. If stream_specifier is given, only those streams that match the specifier are used (see the Stream specifiers section for the stream_specifier syntax).

A - character before the stream identifier creates a "negative" mapping. It disables matching streams from already created mappings. ๐Ÿ™…โ€โ™€๏ธ

An optional view_specifier may be given after the stream specifier, which for multiview video specifies the view to be used. The view specifier may have one of the following formats:

  • view:view_id โ€” select a view by its ID; view_id may be set to 'all' to use all the views interleaved into one stream;
  • vidx:view_idx โ€” select a view by its index; i.e. 0 is the base view, 1 is the first non-base view, etc.
  • vpos:position โ€” select a view by its display position; position may be "left" or "right"

The default for transcoding is to only use the base view, i.e. the equivalent of vidx:0. For streamcopy, view specifiers are not supported and all views are always copied. ๐ŸŒ€

A trailing ? after the stream index will allow the map to be optional: if the map matches no streams the map will be ignored instead of failing. but wait โ€” note the map will still fail if an invalid input file index is used; such as if the map refers to a non-existent input. ๐Ÿ’€

An alternative [linklabel] form will map outputs from complex filter graphs (see the -filter_complex option) to the output file. linklabel must correspond to a defined output link label in the graph. ๐Ÿ”—

This option may be specified multiple times, each adding more streams to the output file. Any given input stream may also be mapped any number of times as a source for different output streams, e.g. in order to use different encoding options and/or filters. The streams are created in the output in the same order in which the -map options are given on the commandline. ๐Ÿ‘‘

Using this option disables the default mappings for this output file. periodt. ๐Ÿ’…

Examples:

map everything

To map ALL streams from the first input file to output:

ffmpeg -i INPUT -map 0 output

select specific stream

If you have two audio streams in the first input file, these streams are identified by 0:0 and 0:1. You can use -map to select which streams to place in an output file. For example:

ffmpeg -i INPUT -map 0:1 out.wav

will map the second input stream in INPUT to the (single) output stream in out.wav. ๐ŸŽฏ

create multiple streams

To select the stream with index 2 from input file a.mov (specified by the identifier 0:2), and stream with index 6 from input b.mov (specified by the identifier 1:6), and copy them to the output file out.mov:

ffmpeg -i a.mov -i b.mov -c copy -map 0:2 -map 1:6 out.mov

create multiple streams 2

To select all video and the third audio stream from an input file:

ffmpeg -i INPUT -map 0:v -map 0:a:2 OUTPUT

negative map

To map all the streams except the second audio, use negative mappings:

ffmpeg -i INPUT -map 0 -map -0:a:1 OUTPUT

optional map

To map the video and audio streams from the first input, and using the trailing ?, ignore the audio mapping if no audio streams exist in the first input:

ffmpeg -i INPUT -map 0:v -map 0:a? OUTPUT

๐Ÿ—ฃ๏ธ map by language ๐Ÿ—ฃ๏ธ

So you want the English audio track specifically? Say less, bestie:

ffmpeg -i INPUT -map 0:m:language:eng OUTPUT

  • -ignore_unknown โ€” be chill about input streams whose type nobody can figure out: ignore them instead of failing when someone tries to copy them. Ignorance is bliss ๐Ÿ’….
  • -copy_unknown โ€” opposite energy, and honestly kind of brave: let those unknown-type input streams get copied instead of failing at the attempt. Risk it for the biscuit ๐Ÿ“.
  • -map_metadata[:metadata_spec_out] infile[:metadata_spec_in] (output, per-metadata) โ€” tells the next output file to snag its metadata from infile. Heads up though: those are file indices (zero-based), not filenames, okay? Not "input.mkv", just a number ๐Ÿ”ข.

The optional metadata_spec_in/metadata_spec_out bits say which metadata to copy. A metadata specifier can look like this:

  • g โ€” global metadata, aka the metadata that applies to the whole file.
  • s[:stream_spec] โ€” per-stream metadata. stream_spec is a stream specifier, same deal as described in the Stream specifiers chapter. In an input metadata specifier, the first matching stream gets copied from. In an output metadata specifier, all matching streams get copied to. Yes, that asymmetry is real, ngl.
  • c:chapter_index โ€” per-chapter metadata, where chapter_index is the zero-based chapter index.
  • p:program_index โ€” per-program metadata, where program_index is the zero-based program index.

If you justโ€ฆ don't specify one? It defaults to global. Easy โœจ.

By default, global metadata is copied from the first input file, and per-stream and per-chapter metadata gets copied along with its streams/chapters. Those default mappings get switched off the moment you create any mapping of the relevant type. And a negative file index is the pro move for "actually, don't": it creates a dummy mapping that just disables the automatic copying ๐Ÿ™ˆ.

Example time! Copy metadata from the first stream of the input file into the global metadata of the output file:

ffmpeg -i in.ogg -map_metadata 0:s:0 out.mp3

And the reverse, bestie โ€” global metadata out to all the audio streams:

ffmpeg -i in.mkv -map_metadata:s:a 0:g out.mkv

Lowkey a fun fact: a plain 0 would work just as well in that example, since global metadata is assumed by default ๐Ÿ‘‘.

  • -map_chapters input_file_index (output) โ€” copy chapters from the input file with index input_file_index into the next output file. If you specify no chapter mapping at all, chapters get copied from the first input file that has at least one chapter. Want none of that? Negative file index, copy zero chapters, done ๐ŸŽ€.
  • -benchmark (global) โ€” shows benchmarking info at the end of an encode: real, system and user time used, plus maximum memory consumption. Plot twist: max memory consumption isn't supported on all systems, and when it isn't, it'll usually just display as 0. Not a bug, it's a vibe check it can't pass ๐Ÿ˜ญ.
  • -benchmark_all (global) โ€” same benchmarking energy but during the encode. Shows real, system and user time used in various steps (audio/video encode/decode). For the girlies who need timestamps on their timestamps โฑ๏ธ.
  • -timelimit duration (global) โ€” dip out after ffmpeg has been running for duration seconds of CPU user time. Note: user time, not "how long I've been staring at the progress bar" time ๐Ÿ’€.
  • -dump (global) โ€” dumps every single input packet to stderr. Every one. Prepare to be humbled by log volume ๐ŸŒŠ.
  • -hex (global) โ€” when you're dumping packets, also dump the payload. Hexadecimal on main ๐Ÿฆ‹.
  • -readrate speed (input) โ€” caps how fast input gets read.

The value is a floating-point positive number, and it represents the maximum duration of media, in seconds, that should be ingested in one second of wallclock time. Default value is zero, which means no imposed limitation on ingestion speed. Value 1 means real-time speed and is equivalent to "-re".

Mainly used to simulate a capture device or a live input stream (like when you're reading from a file). Should not be used with a low value when the input is an actual capture device or live stream โ€” it may cause packet loss. So don't do that, fr fr ๐Ÿ™.

It's useful when the flow speed of output packets actually matters to you, like in live streaming.

  • -re (input) โ€” read input at native frame rate. This is equivalent to setting "-readrate 1". Iconic, short, does exactly what it says ๐Ÿซถ.
  • -readrate_initial_burst seconds โ€” set an initial read burst time, in seconds, after which -re/-readrate gets enforced. Like a running start before the leash goes on ๐Ÿƒโ€โ™€๏ธ.
  • -readrate_catchup speed (input) โ€” if either the input or the output gets blocked and the actual read speed falls behind the specified readrate, then this rate takes effect until the input catches up with the specified readrate. Constraint: it must not be lower than the primary readrate. No sandbagging ๐Ÿšซ.
  • -vsync parameter (global) โ€” and also -fps_mode[:stream_specifier] parameter (output, per-stream) โ€” sets the video sync method / framerate mode. vsync applies to all output video streams but can be overridden for a single stream by setting fps_mode. Also, heads up: vsync is deprecated and will be removed in the future ๐Ÿ’€.

For compatibility reasons, some of the values for vsync can be given as numbers (shown in parentheses below):

  • passthrough (0) โ€” each frame is passed with its timestamp from the demuxer straight to the muxer. No thoughts, head empty, timestamps intact.
  • cfr (1) โ€” frames get duplicated and dropped to achieve exactly the requested constant frame rate. โœจconsistencyโœจ.
  • vfr (2) โ€” frames are passed through with their timestamp, or dropped, so as to prevent 2 frames from having the same timestamp.
  • auto (-1) โ€” chooses between cfr and vfr depending on muxer capabilities. This is the default method ๐Ÿ‘‘.

Note that the timestamps may be further modified by the muxer after all this. For example, in the case that the format option avoid_negative_ts is enabled. So likeโ€ฆ don't come for me if they shift again.

With -map you can select which stream the timestamps should be taken from. You can leave either video or audio unchanged and sync the remaining stream(s) to the unchanged one. Chef's kiss ๐ŸŽ€.

  • -frame_drop_threshold parameter โ€” the frame drop threshold, which specifies how far behind video frames can be before they get dropped. Measured in frame rate units, so 1.0 is one frame. Default is -1.1. One possible usecase: avoid framedrops in the case of noisy timestamps, or increase frame drop precision in the case of exact timestamps. Choose your fighter ๐ŸฅŠ.
  • -apad parameters (output, per-stream) โ€” pad the output audio stream(s). This is the same as applying "-af apad". The argument is a string of filter parameters composed the same way as with the "apad" filter. Big caveat: "-shortest" must be set for this output for the option to take effect. Otherwise it's just sitting there doing nothing, like me at a party ๐Ÿ™ˆ.
  • -copyts โ€” do not process input timestamps; keep their values as-is without trying to sanitize them. In particular, don't remove the initial start time offset value. Feral, but valid.

Note that, depending on the vsync option or on specific muxer processing (e.g. in case the format option avoid_negative_ts is enabled), the output timestamps may mismatch with the input timestamps even when this option is selected. Yeah. Them's the breaks ๐Ÿ˜ญ.

  • -start_at_zero โ€” when used with copyts, shift input timestamps so they start at zero.

Which means using e.g. "-ss 50" will make output timestamps start at 50 seconds, regardless of what timestamp the input file started at. Clean slate energy โœจ.

  • -copytb mode โ€” specifies how to set the encoder timebase when stream copying. mode is an integer numeric value and can be one of these:
    • 1 โ€” use the demuxer timebase. The time base is copied to the output encoder from the corresponding input demuxer. This is sometimes required to avoid non monotonically increasing timestamps when copying video streams with variable frame rate. (Say that five times fast.)
    • 0 โ€” use the decoder timebase. The time base is copied to the output encoder from the corresponding input decoder.
    • -1 โ€” try to make the choice automatically, in order to generate a sane output. Let the algorithm cook ๐Ÿณ.

Default value is -1.

  • -enc_time_base[:stream_specifier] timebase (output, per-stream) โ€” set the encoder timebase. timebase can be one of these:
    • 0 โ€” assign a default value according to the media type. For video, use 1/framerate; for audio, use 1/samplerate.
    • demux โ€” use the timebase from the demuxer.
    • filter โ€” use the timebase from the filtergraph.
    • a positive number โ€” use the provided number as the timebase. This field can be given as a ratio of two integers (e.g. 1:24, 1:48000) or as a decimal number (e.g. 0.04166, 2.0833e-5).

Default value is 0.

  • -bitexact (input/output) โ€” enable bitexact mode for (de)muxer and (de/en)coder. Byte-for-byte commitment issues: none ๐Ÿงš.
  • -shortest (output) โ€” finish encoding when the shortest output stream ends.

Note that this option may require buffering frames, which introduces extra latency. The maximum amount of that latency may be controlled with the "-shortest_buf_duration" option. Good to know before you blame the buffer ๐Ÿ’….

  • -shortest_buf_duration duration (output) โ€” the "-shortest" option may require buffering potentially large amounts of data when at least one of the streams is "sparse" (i.e. has large gaps between frames โ€” this is typically the case for subtitles, which are drama queens about timing).

This option controls the maximum duration of buffered frames, in seconds. Larger values may allow the "-shortest" option to produce more accurate results, but they increase memory use and latency. Trade-offs! Always trade-offs ๐Ÿ˜ค.

The default value is 10 seconds.

  • -dts_delta_threshold threshold โ€” timestamp discontinuity delta threshold, expressed as a decimal number of seconds.

The timestamp discontinuity correction this enables is only applied to input formats that accept timestamp discontinuity (the ones where the "AVFMT_TS_DISCONT" flag is enabled), e.g. MPEG-TS and HLS. And it's automatically disabled when you're using the "-copyts" option (unless wrapping is detected).

If a timestamp discontinuity is detected whose absolute value is greater than threshold, ffmpeg will remove the discontinuity by decreasing/increasing the current DTS and PTS by the corresponding delta value. Poof, gone โœจ.

The default value is 10.

  • -dts_error_threshold threshold โ€” timestamp error delta threshold, expressed as a decimal number of seconds.

This timestamp correction is only applied to input formats that do not accept timestamp discontinuity (the ones where the "AVFMT_TS_DISCONT" flag is not enabled). Different club, different rules.

If a timestamp discontinuity is detected whose absolute value is greater than threshold, ffmpeg will drop the PTS/DTS timestamp value. Yeet ๐Ÿ—‘๏ธ.

The default value is "3600*30" (30 hours), which is arbitrarily picked and quite conservative. iykyk.

  • -muxdelay seconds (output) โ€” set the maximum demux-decode delay. That's the whole description, bestie, don't ask me for more ๐Ÿ’œ.
  • -muxpreload seconds (output) โ€” sets the initial demux-decode delay. that's it, that's the whole vibe ๐Ÿ’…
  • -streamid output-stream-index:new-value (output) โ€” slaps a brand new stream-id value onto an output stream. bestie, listen: you gotta put this before the output filename it's meant for, okay? and if you've got multiple output files living their truth, a streamid can absolutely be reassigned to a different value. no cap.

for example, to set the stream 0 PID to 33 and the stream 1 PID to 36 for an output mpegts file:

ffmpeg -i inurl -streamid 0:33 -streamid 1:36 out.ts
  • -bsf[:stream_specifier] bitstream_filters (input/output, per-stream) โ€” applies bitstream filters to the matching streams. the filters hit each packet as it's received from the demuxer (when you use it as an input option) or right before it gets sent to the muxer (when you use it as an output option). โœจ

bitstream_filters is a comma-separated list of bitstream filter specs, each one shaped like this:

<filter>[=<optname0>=<optval0>:<optname1>=<optval1>:...]

any of the , = : characters that are supposed to be part of an option value need to be escaped with a backslash. yes, really. ๐Ÿ™ˆ

use the -bsfs option to get the list of bitstream filters.

e.g.

ffmpeg -bsf:v h264_mp4toannexb -i h264.mp4 -c:v copy -an out.h264

applies the h264_mp4toannexb bitstream filter (it converts an MP4-encapsulated H.264 stream to Annex B) to the input video stream. iconic behaviour honestly.

on the other hand,

ffmpeg -i file.mov -an -vn -bsf:s mov2textsub -c:s copy -f rawvideo sub.txt

applies the mov2textsub bitstream filter (which extracts text from MOV subtitles) to the output subtitle stream. but heads up ๐Ÿซถ โ€” since both examples use -c copy, it matters very little whether the filters get applied on input or output. that would change if transcoding was happening.

  • -tag[:stream_specifier] codec_tag (input/output, per-stream) โ€” forces a tag/fourcc for the matching streams. forcing it. with intent. ๐Ÿ’…
  • -timecode hh:mm:ssSEPff โ€” specifies the timecode for writing. SEP is : for non drop timecode and ; (or .) for drop. lowkey important detail, don't skip it.
ffmpeg -i input.mpg -timecode 01:02:03.04 -r 30000/1001 -s ntsc output.mpg
  • -filter_complex filtergraph (global) โ€” defines a complex filtergraph, meaning one with an arbitrary number of inputs and/or outputs. for simple graphs โ€” the ones with one input and one output of the same type โ€” go see the -filter options instead. filtergraph is a description of the filtergraph, as described in the ``Filtergraph syntax'' section of the ffmpeg-filters manual. this option may be specified multiple times โ€” every single use creates a brand new complex filtergraph. ๐Ÿ’–

inputs to a complex filtergraph can come from different source types, and you can tell them apart by the format of the corresponding link label:

  • to connect an input stream, use [file_index:stream_specifier] (i.e. the same syntax as -map). if stream_specifier matches multiple streams, the first one will be used. for multiview video, the stream specifier may be followed by the view specifier โ€” see the documentation for the -map option for its syntax.
  • to connect a loopback decoder use [dec:dec_idx], where dec_idx is the index of the loopback decoder to be connected to the given input. for multiview video, the decoder index may be followed by the view specifier โ€” see the documentation for the -map option for its syntax.
  • to connect an output from another complex filtergraph, use its link label. e.g. the following example:
ffmpeg -i input.mkv \
  -filter_complex '[0:v]scale=size=hd1080,split=outputs=2[for_enc][orig_scaled]' \
  -c:v libx264 -map '[for_enc]' output.mkv \
  -dec 0:0 \
  -filter_complex '[dec:0][orig_scaled]hstack[stacked]' \
  -map '[stacked]' -c:v ffv1 comparison.mkv

reads an input video and

  • (line 2) uses a complex filtergraph with one input and two outputs to scale the video to 1920x1080 and duplicate the result to both outputs;
  • (line 3) encodes one scaled output with libx264 and writes the result to output.mkv;
  • (line 4) decodes this encoded stream with a loopback decoder;
  • (line 5) places the output of the loopback decoder (i.e. the libx264-encoded video) side by side with the scaled original input;
  • (line 6) the combined video is then losslessly encoded and written into comparison.mkv.

note that the two filtergraphs cannot be combined into one, because then there would be a cycle in the transcoding pipeline (filtergraph output goes to encoding, from there to decoding, then back to the same graph), and such cycles are not allowed. no exceptions bestie, cycles are not the move ๐Ÿ’€

an unlabeled input will be connected to the first unused input stream of the matching type.

output link labels are referred to with -map. unlabeled outputs get added to the first output file.

ngl this is the fun part: with this option it's possible to use only lavfi sources without any normal input files. โœจ

for example, to overlay an image over video

ffmpeg -i video.mkv -i image.png -filter_complex '[0:v][1:v]overlay[out]' -map '[out]' out.mkv

here [0:v] refers to the first video stream in the first input file, which is linked to the first (main) input of the overlay filter. similarly the first video stream in the second input is linked to the second (overlay) input of overlay.

assuming there is only one video stream in each input file, we can omit input labels, so the above is equivalent to

ffmpeg -i video.mkv -i image.png -filter_complex 'overlay[out]' -map '[out]' out.mkv

furthermore we can omit the output label and the single output from the filter graph will be added to the output file automatically, so we can simply write

ffmpeg -i video.mkv -i image.png -filter_complex 'overlay' out.mkv

as a special exception, you can use a bitmap subtitle stream as input: it will be converted into a video with the same size as the largest video in the file, or 720x576 if no video is present. โš ๏ธ note that this is an experimental and temporary solution โ€” it will be removed once libavfilter has proper support for subtitles. so like, don't build your whole personality around it.

for example, to hardcode subtitles on top of a DVB-T recording stored in MPEG-TS format, delaying the subtitles by 1 second:

ffmpeg -i input.ts -filter_complex \
  '[#0x2ef] setpts=PTS+1/TB [sub] ; [#0x2d0] [sub] overlay' \
  -sn -map '#0x2dc' output.mkv

(0x2d0, 0x2dc and 0x2ef are the MPEG-TS PIDs of respectively the video, audio and subtitles streams; 0:0, 0:3 and 0:7 would have worked too ๐Ÿซถ)

to generate 5 seconds of pure red video using the lavfi color source:

ffmpeg -filter_complex 'color=c=red' -t 5 out.mkv
  • -filter_complex_threads nb_threads (global) โ€” defines how many threads get used to process a filter_complex graph. similar to filter_threads but it's used for -filter_complex graphs only. the default is the number of available CPUs. she's multithreaded and she's thriving ๐Ÿงš
  • -lavfi filtergraph (global) โ€” define a complex filtergraph, i.e. one with an arbitrary number of inputs and/or outputs. equivalent to -filter_complex. literally the same thing, different outfit ๐Ÿ’…
  • -accurate_seek (input) โ€” this option enables or disables accurate seeking in input files with the -ss option. it's enabled by default, so seeking is accurate when transcoding. use -noaccurate_seek to disable it, which may be useful e.g. when copying some streams and transcoding the others. ๐ŸŽ€
  • -seek_timestamp (input) โ€” this option enables or disables seeking by timestamp in input files with the -ss option. it's disabled by default. if enabled, the argument to the -ss option is considered an actual timestamp, and is not offset by the start time of the file. this matters only for files which do not start from timestamp 0, such as transport streams. iykyk.
  • -thread_queue_size size (input/output) โ€” for input, this option sets the maximum number of queued packets when reading from the file or device. with low latency / high rate live streams, packets may get discarded if they aren't read in a timely manner; setting this value can force ffmpeg to use a separate input thread and read packets as soon as they arrive. by default ffmpeg only does this if multiple inputs are specified.

for output, this option specifies the maximum number of packets that may be queued to each muxing thread. queue management, but make it cute โœจ

  • -sdp_file file (global) โ€” print sdp information for an output stream to file. this allows dumping sdp information when at least one output isn't an rtp stream. (requires at least one of the output formats to be rtp, bestie โ€” that part's non-negotiable).
  • -discard (input) โ€” allows discarding specific streams or frames from streams. any input stream can be fully discarded using the value all, whereas selective discarding of frames from a stream happens at the demuxer and is not supported by all demuxers. ๐Ÿ™ˆ
    • none โ€” discard no frame.
    • default โ€” the default, which discards no frames.
    • noref โ€” discard all non-reference frames.
    • bidir โ€” discard all bidirectional frames.
    • nokey โ€” discard all frames excepts keyframes.
    • all โ€” discard all frames.
  • -abort_on flags (global) โ€” stop and abort on various conditions. the following flags are available:
    • empty_output โ€” no packets were passed to the muxer, the output is empty.
    • empty_output_stream โ€” no packets were passed to the muxer in some of the output streams.
  • -max_error_rate (global) โ€” sets the fraction of decoding frame failures across all inputs which, when crossed, makes ffmpeg return exit code 69. crossing this threshold does not terminate processing. range is a floating-point number between 0 and 1. default is 2/3. nice.
  • -xerror (global) โ€” stop and exit on error. that's it. zero notes. she does not forgive ๐Ÿ’€
  • -max_muxing_queue_size packets (output, per-stream) โ€” when transcoding audio and/or video streams, ffmpeg will not begin writing into the output until it has one packet for each such stream. while waiting for that to happen, packets for other streams get buffered. this option sets the size of that buffer, in packets, for the matching output stream.
the default value of this option should be high enough for most uses, so only touch this option if you are sure that you need it. hands off the dials unless you know what you're doing, bestie ๐Ÿซถ
  • -muxing_queue_data_threshold bytes (output,per-stream) โ€” this is like a minimum threshold, and until you hit it the muxing queue size is just... not taken into account bestie. Defaults to 50 megabytes per stream, and it's based on the overall size of packets passed to the muxer.
  • -auto_conversion_filters (global) โ€” turns on automatically inserting format conversion filters in all filter graphs, including the ones defined by -vf, -af, -filter_complex and -lavfi. If filter format negotiation needs a conversion, the initialization of the filters will fail ๐Ÿ˜ญ. Conversions can still be performed by inserting the relevant conversion filter (scale, aresample) in the graph. It's on by default, so to explicitly disable it you gotta say -noauto_conversion_filters.
  • -bits_per_raw_sample[:stream_specifier] value (output,per-stream) โ€” declares the number of bits per raw sample in the given output stream to be value. Heads up tho: this option sets the information given to the encoder/muxer, it does not change the stream to conform to this value. Setting values that don't match the stream properties may result in encoding failures or invalid output files ๐Ÿ’€.
  • -stats_enc_pre[:stream_specifier] path (output,per-stream) / -stats_enc_post[:stream_specifier] path (output,per-stream) / -stats_mux_pre[:stream_specifier] path (output,per-stream) โ€” write per-frame encoding info about the matching streams into the file given by path.

-stats_enc_pre writes information about raw video or audio frames right before they're sent for encoding, while -stats_enc_post writes information about encoded packets as they're received from the encoder. -stats_mux_pre writes information about packets just as they're about to be sent to the muxer. Every frame or packet produces one line in the specified file. The format of that line is controlled by -stats_enc_pre_fmt / -stats_enc_post_fmt / -stats_mux_pre_fmt.

When stats for multiple streams are written into a single file, the lines corresponding to different streams will be interleaved ๐Ÿ™ˆ. The precise order of this interleaving is not specified and not guaranteed to stay stable between different invocations of the program, even with the same options. So don't come for me if the order shifts, it's giving chaos on purpose.

  • -stats_enc_pre_fmt[:stream_specifier] format_spec (output,per-stream) / -stats_enc_post_fmt[:stream_specifier] format_spec (output,per-stream) / -stats_mux_pre_fmt[:stream_specifier] format_spec (output,per-stream) โ€” specify the format for the lines written with -stats_enc_pre / -stats_enc_post / -stats_mux_pre.

format_spec is a string that may contain directives of the form {fmt}. format_spec is backslash-escaped โ€” use \{, \}, and \\ to write a literal {, }, or \, respectively, into the output.

The directives given with fmt may be one of these:

  • fidx โ€” index of the output file.
  • sidx โ€” index of the output stream in the file.
  • n โ€” frame number. Pre-encoding: number of frames sent to the encoder so far. Post-encoding: number of packets received from the encoder so far. Muxing: number of packets submitted to the muxer for this stream so far.
  • ni โ€” input frame number. Index of the input frame (i.e. output by a decoder) that corresponds to this output frame or packet. -1 if unavailable.
  • tb โ€” timebase in which this frame/packet's timestamps are expressed, as a rational number num/den. Note that encoder and muxer may use different timebases.
  • tbi โ€” timebase for ptsi, as a rational number num/den. Available when ptsi is available, 0/1 otherwise.
  • pts โ€” presentation timestamp of the frame or packet, as an integer. Should be multiplied by the timebase to compute presentation time.
  • ptsi โ€” presentation timestamp of the input frame (see ni), as an integer. Should be multiplied by tbi to compute presentation time. Printed as (2^63 - 1 = 9223372036854775807) when not available.
  • t โ€” presentation time of the frame or packet, as a decimal number. Equal to pts multiplied by tb.
  • ti โ€” presentation time of the input frame (see ni), as a decimal number. Equal to ptsi multiplied by tbi. Printed as inf when not available.
  • dts (packet) โ€” decoding timestamp of the packet, as an integer. Should be multiplied by the timebase to compute presentation time.
  • dt (packet) โ€” decoding time of the frame or packet, as a decimal number. Equal to dts multiplied by tb.
  • sn (frame,audio) โ€” number of audio samples sent to the encoder so far.
  • samp (frame,audio) โ€” number of audio samples in the frame.
  • size (packet) โ€” size of the encoded packet in bytes.
  • br (packet) โ€” current bitrate in bits per second.
  • abr (packet) โ€” average bitrate for the whole stream so far, in bits per second, -1 if it can't be determined at this point.
  • key (packet) โ€” character 'K' if the packet contains a keyframe, character 'N' otherwise.

Directives tagged with packet may only be used with -stats_enc_post_fmt and -stats_mux_pre_fmt.

Directives tagged with frame may only be used with -stats_enc_pre_fmt.

Directives tagged with audio may only be used with audio streams.

The default format strings are:

  • pre-encoding โ€” {fidx} {sidx} {n} {t}
  • post-encoding โ€” {fidx} {sidx} {n} {t}
In the future, new items may be added to the end of the default formatting strings. Users who depend on the format staying exactly the same should prescribe it manually. No cap, write your own format if you're particular about it ๐Ÿ’…

Note that stats for different streams written into the same file may have different formats.


๐ŸŽ€ Preset files ๐ŸŽ€

A preset file contains a sequence of option=value pairs, one for each line, specifying a sequence of options which would be awkward to specify on the command line. Lines starting with the hash ('#') character are ignored and are used to provide comments. Check the presets directory in the FFmpeg source tree for examples.

There are two types of preset files: ffpreset and avpreset files.

๐ŸŒธ ffpreset files ๐ŸŒธ

ffpreset files are specified with the "vpre", "apre", "spre", and "fpre" options. The "fpre" option takes the filename of the preset instead of a preset name as input and can be used for any kind of codec. For the "vpre", "apre", and "spre" options, the options specified in a preset file are applied to the currently selected codec of the same type as the preset option.

The argument passed to the "vpre", "apre", and "spre" preset options identifies the preset file to use according to these rules, bestie, pay attention:

First ffmpeg searches for a file named arg.ffpreset in the directories $FFMPEG_DATADIR (if set), and $HOME/.ffmpeg, and in the datadir defined at configuration time (usually PREFIX/share/ffmpeg) or in a ffpresets folder along the executable on win32, in that order. For example, if the argument is "libvpx-1080p", it will search for the file libvpx-1080p.ffpreset.

If no such file is found, then ffmpeg will search for a file named codec_name-arg.ffpreset in the above-mentioned directories, where codec_name is the name of the codec to which the preset file options will be applied. For example, if you select the video codec with -vcodec libvpx and use -vpre 1080p, then it will search for the file libvpx-1080p.ffpreset. Iconic search behavior honestly โœจ

๐Ÿฆ‹ avpreset files ๐Ÿฆ‹

avpreset files are specified with the "pre" option. They work similar to ffpreset files, but they only allow encoder-specific options. Therefore, an option=value pair specifying an encoder cannot be used.

When the "pre" option is specified, ffmpeg will look for files with the suffix .avpreset in the directories $AVCONV_DATADIR (if set), and $HOME/.avconv, and in the datadir defined at configuration time (usually PREFIX/share/ffmpeg), in that order.

First ffmpeg searches for a file named codec_name-arg.avpreset in the above-mentioned directories, where codec_name is the name of the codec to which the preset file options will be applied. For example, if you select the video codec with -vcodec libvpx and use -pre 1080p, then it will search for the file libvpx-1080p.avpreset.

If no such file is found, then ffmpeg will search for a file named arg.avpreset in the same directories.


๐Ÿ“Š vstats file format ๐Ÿ“Š

The -vstats and -vstats_file options enable generation of a file containing statistics about the generated video outputs.

The -vstats_version option controls the format version of the generated file.

With version 1 the format is:

frame= <FRAME> q= <FRAME_QUALITY> PSNR= <PSNR> f_size= <FRAME_SIZE> s_size= <STREAM_SIZE>kB time= <TIMESTAMP> br= <BITRATE>kbits/s avg_br= <AVERAGE_BITRATE>kbits/s

With version 2 the format is:

out= <OUT_FILE_INDEX> st= <OUT_FILE_STREAM_INDEX> frame= <FRAME_NUMBER> q= <FRAME_QUALITY>f PSNR= <PSNR> f_size= <FRAME_SIZE> s_size= <STREAM_SIZE>kB time= <TIMESTAMP> br= <BITRATE>kbits/s avg_br= <AVERAGE_BITRATE>kbits/s

The value corresponding to each key is described below:

  • avg_br โ€” average bitrate expressed in Kbits/s
  • br โ€” bitrate expressed in Kbits/s
  • frame โ€” number of encoded frame
  • out โ€” out file index
  • PSNR โ€” Peak Signal to Noise Ratio
  • q โ€” quality of the frame
  • f_size โ€” encoded packet size expressed as number of bytes
  • s_size โ€” stream size expressed in KiB
  • st โ€” out file stream index
  • time โ€” time of the packet
  • type โ€” picture type

See also the -stats_enc options for an alternative way to show encoding statistics ๐Ÿ”ฅ

โœจ EXAMPLES โœจ

okay bestie this is the part where it all comes together โ€” real commands, real vibes, copy-paste ready ๐Ÿซถ


๐ŸŽฅ Video and Audio grabbing

so if you specify the input format and the device, ffmpeg can grab video and audio directly. no middleman, no drama:

ffmpeg -f oss -i /dev/dsp -f video4linux2 -i /dev/video0 /tmp/out.mpg

or, if you'd rather use an ALSA audio source (mono input, card id 1) instead of OSS:

ffmpeg -f alsa -ac 1 -i hw:1 -f video4linux2 -i /dev/video0 /tmp/out.mpg
heads up ๐Ÿ’… โ€” you must activate the right video source and channel before launching ffmpeg with any TV viewer such as <http://linux.bytesex.org/xawtv/> by Gerd Knorr. like, the viewer's gotta be doing its thing first. you also have to set the audio recording levels correctly with a standard mixer, no cap.

๐Ÿ–ฅ๏ธ X11 grabbing

grab the X11 display with ffmpeg via:

ffmpeg -f x11grab -video_size cif -framerate 25 -i :0.0 /tmp/out.mpg

0.0 is the display.screen number of your X11 server, same as the DISPLAY environment variable. iconic.

ffmpeg -f x11grab -video_size cif -framerate 25 -i :0.0+10,20 /tmp/out.mpg

again, 0.0 is the display.screen number of your X11 server, same as the DISPLAY environment variable. 10 is the x-offset and 20 the y-offset for the grabbing. offsets slay ๐Ÿ’…


๐Ÿ”„ Video and Audio file format conversion

any supported file format and protocol can serve as input to ffmpeg. literally any.

Examples:

  • you can use YUV files as input:
ffmpeg -i /tmp/test%d.Y /tmp/out.mpg

it will use the files:

/tmp/test0.Y, /tmp/test0.U, /tmp/test0.V,
/tmp/test1.Y, /tmp/test1.U, /tmp/test1.V, etc...

the Y files use twice the resolution of the U and V files. they're raw files, without header. they can be generated by all decent video decoders. you must specify the size of the image with the -s option if ffmpeg cannot guess it ๐Ÿ‘‘

  • you can input from a raw YUV420P file:
ffmpeg -i /tmp/test.yuv /tmp/out.avi

test.yuv is a file containing raw YUV planar data. each frame is composed of the Y plane followed by the U and V planes at half vertical and horizontal resolution. planar, babes ๐Ÿ’œ

  • you can output to a raw YUV420P file:
ffmpeg -i mydivx.avi hugefile.yuv
  • you can set several input files and output files:
ffmpeg -i /tmp/a.wav -s 640x480 -i /tmp/a.yuv /tmp/a.mpg

converts the audio file a.wav and the raw YUV video file a.yuv to MPEG file a.mpg. multi-tasking queen โœจ

  • you can also do audio and video conversions at the same time:
ffmpeg -i /tmp/a.wav -ar 22050 /tmp/a.mp2

converts a.wav to MPEG audio at 22050 Hz sample rate.

  • you can encode to several formats at the same time and define a mapping from input stream to output streams:
ffmpeg -i /tmp/a.wav -map 0:a -b:a 64k /tmp/a.mp2 -map 0:a -b:a 128k /tmp/b.mp2

converts a.wav to a.mp2 at 64 kbits and to b.mp2 at 128 kbits. -map file:index specifies which input stream is used for each output stream, in the order of the definition of output streams. yeah, the ordering matters, iykyk.

  • you can transcode decrypted VOBs:
ffmpeg -i snatch_1.vob -f avi -c:v mpeg4 -b:v 800k -g 300 -bf 2 -c:a libmp3lame -b:a 128k snatch.avi

this is a typical DVD ripping example โ€” the input is a VOB file, the output an AVI file with MPEG-4 video and MP3 audio. note that in this command we use B-frames so the MPEG-4 stream is DivX5 compatible, and GOP size is 300 which means one intra frame every 10 seconds for 29.97fps input video. furthermore, the audio stream is MP3-encoded so you need to enable LAME support by passing --enable-libmp3lame to configure. the mapping is particularly useful for DVD transcoding to get the desired audio language ๐ŸŒˆ

NOTE: to see the supported input formats, use ffmpeg -demuxers. ๐ŸŽ€
  • you can extract images from a video, or create a video from many images:

for extracting images from a video:

ffmpeg -i foo.avi -r 1 -s WxH -f image2 foo-%03d.jpeg

this will extract one video frame per second from the video and will output them in files named foo-001.jpeg, foo-002.jpeg, etc. images will be rescaled to fit the new WxH values.

if you want to extract just a limited number of frames, you can use the above command in combination with the -frames:v or -t option, or in combination with -ss to start extracting from a certain point in time. lowkey chef's kiss ๐Ÿ‘‘

for creating a video from many images:

ffmpeg -f image2 -framerate 12 -i foo-%03d.jpeg -s WxH foo.avi

the syntax foo-%03d.jpeg specifies to use a decimal number composed of three digits padded with zeroes to express the sequence number. it is the same syntax supported by the C printf function, but only formats accepting a normal integer are suitable. fr fr, don't get cute with it.

when importing an image sequence, -i also supports expanding shell-like wildcard patterns (globbing) internally, by selecting the image2-specific -pattern_type glob option.

for example, for creating a video from filenames matching the glob pattern foo-*.jpeg:

ffmpeg -f image2 -pattern_type glob -framerate 12 -i 'foo-*.jpeg' -s WxH foo.avi
  • you can put many streams of the same type in the output:
ffmpeg -i test1.avi -i test2.avi -map 1:1 -map 1:0 -map 0:1 -map 0:0 -c copy -y test12.nut

the resulting output file test12.nut will contain the first four streams from the input files in reverse order. chaotic but correct ๐Ÿ’€

  • to force CBR video output:
ffmpeg -i myfile.avi -b 4000k -minrate 4000k -maxrate 4000k -bufsize 1835k out.m2v
  • the four options lmin, lmax, mblmin and mblmax use 'lambda' units, but you may use the QP2LAMBDA constant to easily convert from 'q' units:
ffmpeg -i src.ext -lmax 21*QP2LAMBDA dst.ext

๐Ÿ‘€ SEE ALSO ๐Ÿ‘€

ffmpeg-all(1), ffplay(1), ffprobe(1), ffmpeg-utils(1), ffmpeg-scaler(1), ffmpeg-resampler(1), ffmpeg-codecs(1), ffmpeg-bitstream-filters(1), ffmpeg-formats(1), ffmpeg-devices(1), ffmpeg-protocols(1), ffmpeg-filters(1)

like, the whole friend group ๐Ÿซถ go read them too.


๐Ÿ’– AUTHORS ๐Ÿ’–

The FFmpeg developers. the main characters, honestly.

for details about the authorship, see the Git history of the project (<https://git.ffmpeg.org/ffmpeg>), e.g. by typing the command git log in the FFmpeg source directory, or browsing the online repository at <https://git.ffmpeg.org/ffmpeg>.

maintainers for the specific components are listed in the file MAINTAINERS in the source code tree. very organized of them โœจ


and that's a wrap on the whole page, bestie ๐ŸŽ€ this was FFMPEG(1) from the FFmpeg docs โ€” the version and date live in that little footer stamped at the bottom of the real page, so go peep your installed copy for the exact source/version and date ๐Ÿ’œ now go forth and transcode something iconic. periodt. ๐Ÿ’…๐Ÿ”ฅ

๐Ÿ“ฆ where this page comes from