LLVM-PROFDATA(1)

πŸ’…βœ¨ LLVM-PROFDATA(1) β€” llvm-profdata, the profile data tool βœ¨πŸ’…

Welcome to the LLVM-PROFDATA(1) page, bestie β€” this is part 1, and yes there is more coming, so stay perched πŸ’–

🌸 NAME 🌸

llvm-profdata β€” profile data tool. Short name, huge main character energy, literally the whole point πŸŽ€

✨ SYNOPSIS ✨

llvm-profdata command [args...]

πŸ¦‹ DESCRIPTION πŸ¦‹

The llvm-profdata tool is a small utility for working with profile data files. Small utility, very cutesy, but it is lowkey essential when you're doing profile stuff πŸ’œ

πŸ‘‘ COMMANDS πŸ‘‘

  • merge
  • show
  • overlap
  • order

Those are the commands, periodt πŸ’…

πŸ”₯ MERGE πŸ”₯

🌈 SYNOPSIS 🌈

llvm-profdata merge [options] [filename...]

πŸ’œ DESCRIPTION πŸ’œ

llvm-profdata merge takes several profile data files generated by PGO instrumentation and merges them together into a single indexed profile data file. It is the gluing-together command, and it ate, no cap ✨

By default, profile data is merged without modification. That means the relative importance of each input file is proportional to the number of samples or counts it contains. In general, input from a longer training run will be interpreted as relatively more important than a shorter run. Depending on the nature of the training runs, it may be useful to adjust the weight given to each input file by using the -weighted-input option. Basically: longer training run, more influence; shorter run, less influence, and if that's not the vibe you want, reweight it πŸŽ€

Profiles passed in via -weighted-input, -input-files, or via positional arguments are processed once for each time they are seen. Seen twice? Processed twice. That's the rule, fr fr πŸ’«

πŸ’… OPTIONS πŸ’…

  • --help β€” Print a summary of command line options. The classic little helper, we love to see it 🫢
  • --output=<output>, -o β€” Specify the output file name.
🚨 Bestie, output cannot be - β€” the resulting indexed profile data can't be written to standard output. Do not try to pipe this cutie to stdout, it's not that kind of file πŸ’€
  • --weighted-input=<weight,filename> β€” Specify an input file name along with a weight. The profile counts of the supplied filename will be scaled (multiplied) by the supplied weight, where weight is a decimal integer >= 1. Input files specified without using this option are assigned a default weight of 1. Examples are shown below, bestie πŸ‘‡
  • --input-files=<path>, -f β€” Specify a file which contains a list of files to merge. The entries in this file are newline-separated. Lines starting with # are skipped. Entries may be of the form <filename> or <weight>,<filename>. Very list, very organized, slay ✨
  • --remapping-file=<path>, -r β€” Specify a file which contains a remapping from symbol names in the input profile to the symbol names that should be used in the output profile. The file should consist of lines of the form <input-symbol> <output-symbol>. Blank lines and lines starting with # are skipped.

The llvm-cxxmap tool can be used to generate the symbol remapping file. Iconic teamwork πŸ’–

  • --instr (default) β€” Specify that the input profile is an instrumentation-based profile. This is the default, so it's giving "no notes" πŸ’…
  • --sample β€” Specify that the input profile is a sample-based profile.

The format of the generated file can be generated in one of three ways β€” and the page then lists four, I'm just reading it πŸ’€:

  • --binary (default) β€” Emit the profile using a binary encoding. For instrumentation-based profile the output format is the indexed binary format.
  • --extbinary β€” Emit the profile using an extensible binary encoding. This option can only be used with sample-based profile. The extensible binary encoding can be more compact with compression enabled and can be loaded faster than the default binary encoding. Faster loading? Obsessed πŸ¦‹
  • --text β€” Emit the profile in text mode. This option can also be used with both sample-based and instrumentation-based profile. When this option is used the profile will be dumped in the text format that is parsable by the profile reader.
  • --gcc β€” Emit the profile using GCC's gcov format (Not yet supported). The page says Not yet supported, so yeah: not yet, bestie 🌸
  • --sparse[=true|false] β€” Do not emit function records with 0 execution count. Can only be used in conjunction with -instr. Defaults to false, since it can inhibit compiler optimization during PGO.
🚨 Default is false for a reason, babes β€” it can inhibit compiler optimization during PGO. Respect the default πŸ’…
  • --num-threads=<N>, -j β€” Use N threads to perform profile merging. When N=0, llvm-profdata auto-detects an appropriate number of threads to use. This is the default. Parallel merge era πŸ”₯
  • --failure-mode=[any|all] β€” Set the failure mode. There are two options: any causes the merge command to fail if any profiles are invalid, and all causes the merge command to fail only if all profiles are invalid. If all is set, information from any invalid profiles is excluded from the final merged product. The default failure mode is any. Choose your fighter πŸŽ€
  • --prof-sym-list=<path> β€” Specify a file which contains a list of symbols to generate profile symbol list in the profile. This option can only be used with sample-based profile in extbinary format. The entries in this file are newline-separated.
  • --compress-all-sections=[true|false] β€” Compress all sections when writing the profile. This option can only be used with sample-based profile in extbinary format. Compression cutie πŸ’œ
  • --use-md5=[true|false] β€” Use MD5 to represent string in name table when writing the profile. This option can only be used with sample-based profile in extbinary format.
  • --gen-partial-profile=[true|false] β€” Mark the profile to be a partial profile which only provides partial profile coverage for the optimized target. This option can only be used with sample-based profile in extbinary format.
  • --convert-sample-profile-layout=[nest|flat] β€” Convert the merged profile into a profile with a new layout. Supported layout are nest (Nested profile, the input should be CS flat profile) and flat (Profile with nested inlinees flattened out). Layout glow-up πŸ’«
  • --supplement-instr-with-sample=<file> β€” Supplement an instrumentation profile with sample profile. The sample profile is the input of the flag. Output will be in instrumentation format (only works with -instr). Teamwork makes the dream work 🫢
  • --zero-counter-threshold=<float> β€” For the function which is cold in instr profile but hot in sample profile, if the ratio of the number of zero counters divided by the total number of counters is above the threshold, the profile of the function will be regarded as being harmful for performance and will be dropped. Cold in one profile, hot in another, and potentially harmful? Dropped, periodt πŸ’€
  • --instr-prof-cold-threshold=<int> β€” User specified cold threshold for instr profile which will override the cold threshold got from profile summary. You said what you said, and it overrides πŸŽ€
  • --suppl-min-size-threshold=<int> β€” If the size of a function is smaller than the threshold, assume it can be inlined by PGO early inliner and it will not be adjusted based on sample profile. Tiny function behavior, very demure 🌸
  • --debug-info=<path> β€” Specify the executable or .dSYM that contains debug info for the raw profile. When --debug-info-correlate or --profile-correlate=debug-info was used for instrumentation, use this option to correlate the raw profile.
  • --binary-file=<path> β€” Specify the executable that contains profile data and profile name sections for the raw profile. When -profile-correlate=binary was used for instrumentation, use this option to correlate the raw profile.
  • --temporal-profile-trace-reservoir-size β€” The maximum number of temporal profile traces to be stored in the output profile. If more traces are added, we will use reservoir sampling to select which traces to keep. Note that changing this value between different merge invocations on the same indexed profile could result in sample bias. The default value is 100. Reservoir sampling said "I'll decide" πŸ’…
  • --temporal-profile-max-trace-length β€” The maximum number of functions in a single temporal profile trace. Longer traces will be truncated. The default value is 1000. Long trace? Truncated, bestie βœ‚οΈ
  • --function=<string> β€” Only keep functions matching the regex in the output, all others are erased from the profile. Regex said keep, everything else said bye πŸ‘‹
  • --no-function=<string> β€” Remove functions matching the regex from the profile. If both --function and --no-function are specified and a function matches both, it is removed. Both match? Removed. No cap 🚨

πŸŽ€ EXAMPLES πŸŽ€

🌟 Basic Usage 🌟

Merge three profiles:

llvm-profdata merge foo.profdata bar.profdata baz.profdata -output merged.profdata

πŸ’– Weighted Input πŸ’–

The input file foo.profdata is especially important, multiply its counts by 10:

llvm-profdata merge --weighted-input=10,foo.profdata bar.profdata baz.profdata --output merged.profdata

Exactly equivalent to the previous invocation (explicit form; useful for programmatic invocation):

llvm-profdata merge --weighted-input=10,foo.profdata --weighted-input=1,bar.profdata --weighted-input=1,baz.profdata --output merged.profdata

Part 2 is literally next, bestie β€” this page keeps going πŸ’–

✨ SHOW ✨

SYNOPSIS

llvm-profdata show [options] [filename]

DESCRIPTION

Okay so llvm-profdata show is literally the "let me look at it" command β€” it takes a profile data file and shows you all the info about the profile counters in that file, plus the counters for any function(s) you ask about. It's giving detective energy πŸ”πŸ’…

And if you leave out filename or just pass -? Then llvm-profdata show reads its input from standard input. Slay, piped input works.

OPTIONS

  • --all-functions β€” print the details for every function, no filter, no skips, all of them πŸ‘‘
  • --binary-ids β€” print the embedded binary ids that live inside a profile.
  • --counts β€” print out the actual counter values for the functions being displayed.
  • --show-format=<text|json|yaml> β€” emit the output in the chosen format, but only if the profile type you've got actually supports it. iykyk.
  • --function=<string> β€” print details for a function whenever that function's name contains the given string πŸŽ€
  • --help β€” print a summary of the command line options.
  • --output=<output>, -o β€” specify the output file name. If output is -, or you just don't specify it at all, the output goes to standard output.
  • --instr (default) β€” says the input profile is an instrumentation-based profile. This is the default, bestie.
  • --text β€” tells the profile dumper to show the profile counts in the text format of the instrumentation-based profile data representation. By default the profile info gets dumped in a more human-readable form (also text, just with annotations). Cute either way πŸ’–
  • --topn=<n> β€” tells the profile dumper to show the top n functions with the hottest basic blocks up in the summary section. By default those topn functions are not dumped.
  • --sample β€” says the input profile is a sample-based profile.
  • --memop-sizes β€” show the profiled sizes of the memory intrinsic calls for the functions being shown.
  • --value-cutoff=<n> β€” only show functions whose max count values are greater than or equal to n. Default cutoff is 0.
  • --list-below-cutoff β€” only output the names of functions whose max count value falls below the cutoff value. Flip side of the coin πŸͺ™
  • --profile-version β€” print the profile version.
  • --showcs β€” only show context sensitive profile counts. The default filters all context sensitive profile counts out.
  • --show-prof-sym-list=[true|false] β€” show the profile symbol list if it exists in the profile. Heads up: this option only means anything for a sample-based profile in extbinary format ⚠️
  • --show-sec-info-only=[true|false] β€” show basic info about each section in the profile. Again, only meaningful for a sample-based profile in extbinary format.
  • --debug-info=<path> β€” specify the executable or .dSYM that holds the debug info for the raw profile. So if --debug-info-correlate or --profile-correlate=debug-info was used for instrumentation, use this option to show the correlated functions from the raw profile πŸ”—
  • --covered β€” show only the functions that have actually been executed, i.e. functions with non-zero counts. We love a nonzero era.

πŸ¦‹ OVERLAP πŸ¦‹

SYNOPSIS

llvm-profdata overlap [options] [base profile file] [test profile file]

DESCRIPTION

llvm-profdata overlap takes two profile data files and shows you the overlap of the counter distribution β€” both across the whole files and across any of the specified functions. It's the compatibility-check command, fr fr πŸ’œ

In this command, overlap is defined like this: suppose the base profile file has these counts:

{c1_1, c1_2, ..., c1_n, c1_u_1, c2_u_2, ..., c2_u_s}

and the test profile file has:

{c2_1, c2_2, ..., c2_n, c2_v_1, c2_v_2, ..., c2_v_t}

Here c{1|2}_i (i = 1 .. n) are matched counters, and c1_u_i (i = 1 .. s) and c2_v_i (i = 1 .. v) are unmatched counters (or counters only existing in) the base profile file and the test profile file, respectively. Then:

sum_1 = c1_1 + c1_2 +  ... + c1_n +  c1_u_1 + c2_u_2 + ... + c2_u_s
sum_2 = c2_1 + c2_2 + ... + c2_n + c2_v_1 + c2_v_2 + ... + c2_v_t
overlap = min(c1_1/sum_1, c2_1/sum_2) + min(c1_2/sum_1, c2_2/sum_2) + ...  + min(c1_n/sum_1, c2_n/sum_2)

The result overlap distribution is a percentage number, ranging from 0.0% to 100.0%, where 0.0% means there's no overlap at all and 100.0% means a perfect overlap. Periodt πŸ’…

Here's an example: if the base profile file has counts of {400, 600}, and the test profile file has matched counts of {60000, 40000}, the overlap is 80%. Math ate that one up ✨

OPTIONS

  • --function=<string> β€” print details for a function if that function's name contains the given string.
  • --help β€” print a summary of the command line options.
  • --output=<output>, -o β€” specify the output file name. If output is -, or it isn't specified, the output goes to standard output.
  • --value-cutoff=<n> β€” only show functions whose max count values are greater than or equal to n. By default the value-cutoff is set to the max of unsigned long long 😭 (yes, that big)
  • --cs β€” only show overlap for the context sensitive profile counts. The default is to show non-context sensitive profile counts.

🌸 ORDER 🌸

SYNOPSIS

llvm-profdata order [options] [filename]

DESCRIPTION

llvm-profdata order uses temporal profiling traces from a profile and finds a function order that reduces the number of page faults for those traces. Basically it's out here rearranging your functions so your program stops tripping over itself πŸ§šβ€β™€οΈ

This output can be passed directly to lld via --symbol-ordering-file= for ELF, or -order-file for Mach-O. And if the traces found in the profile are actually representative of the real world, then this order should improve startup performance. Iconic behaviour honestly πŸ”₯

OPTIONS

  • --help β€” print a summary of the command line options.
  • --output=<output>, -o β€” specify the output file name. If output is -, or it isn't specified, the output goes to standard output.

πŸ’€ EXIT STATUS πŸ’€

llvm-profdata returns 1 if the command is omitted or is invalid, if it can't read the input files, or if there's a mismatch between their data. So a 1 here is the "something's off bestie" signal β€” no cap πŸ™ˆ


πŸ‘‘ AUTHOR πŸ‘‘

Maintained by the LLVM Team (https://llvm.org/).


2003-2025, LLVM Project


Okay that's the whole page, you made it to the end!! 🫢 This was page 19 of LLVM-PROFDATA(1), dated 2025-01-17 β€” go forth and profile responsibly, bestie πŸ’–βœ¨πŸŒˆ

πŸ“¦ where this page comes from