NGRAMSORT(1)
β¨ NGRAMSORT β the ngramsort(1) glow-up β¨
okay bestie, pull up a chair, we're sorting ngrams and we're gonna look cute doing it π
πΈ NAME πΈ
ngramsort β literally the manual page for ngramsort version 1.3.17, no cap
π¦ DESCRIPTION π¦
So here's the vibe: it sorts an ngram LM in lexicographic state context order. That's it. That's the whole job. She's a one-trick pony and she ate. π
Usage, and yes you're gonna wanna memorize this:
ngramsort [--options] [in.fst [out.fst]]
π PROGRAM FLAGS π
these are her flags, the ones that belong to ngramsort herself π
--backoff_labelβ type =int64_t, default =0. This one's the backoff label. iconic.--check_consistencyβ type =bool, default =false. Checks the model's consistency for you. she's thorough like that π«Ά--norm_epsβ type =double, default =0.001. The normalization check epsilon. tiny little number, big responsibilities β
π LIBRARY FLAGS π
these ones come from the library, they're the shared friend group π
π Flags from: flags.cc
--helpβ type =bool, default =false. Shows usage information. bestie behaviour fr fr--helpshortβ type =bool, default =false. Shows brief usage information. the tl;dr version π--tmpdirβ type =std::string, default ="/tmp". The temporary directory. that's where the chaos lives π--vβ type =int32_t, default =0. Verbosity level. turn it up if you wanna hear her yap π₯
π¦ Flags from: fst.cc
--fst_alignβ type =bool, default =false. Writes FST data aligned where appropriate. alignment? slay β¨--fst_default_cache_gcβ type =bool, default =true. Enables garbage collection of the cache. she cleans up after herself, we love a tidy queen π§Ή--fst_default_cache_gc_limitβ type =int64_t, default =1048576. The cache byte size that triggers garbage collection. one million forty-eight thousand five hundred seventy-six bytes and then she starts tidying π--fst_read_modeβ type =std::string, default ="read". Default file reading mode for mappable files.--fst_verify_propertiesβ type =bool, default =false. Verify FST properties queried byTestProperties. she checks receipts π§Ύ--save_relabel_ipairsβ type =std::string, default ="". Save input relabel pairs to file.--save_relabel_opairsβ type =std::string, default ="". Save output relabel pairs to file.
πΈ Flags from: symbol-table.cc
--fst_compat_symbolsβ type =bool, default =true. Requires symbol tables to match when appropriate. compatibility check, periodt π--fst_field_separatorβ type =std::string, default =" ". The set of characters used as a separator between printed fields. yes that default is a whole bunch of whitespace, don't perceive it, just accept it π
π Flags from: util.cc
--fst_error_fatalβ type =bool, default =true. FST errors are fatal; o.w. return objects flagged as bad: e.g., FSTs:kErrorproperty set, FST weights: not aMember(). so like, either she panics or she hands you back something marked as bad. dramatic either way π
π Flags from: weight.cc
--fst_weight_parenthesesβ type =std::string, default ="". Characters enclosing the first weight of a printed composite weight (e.g., pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size0(none) or2(open and close parenthesis). so it's giving all or nothing, and honestly? same π--fst_weight_separatorβ type =std::string, default =",". Character separator between printed composite weights; must be a single character. exactly one. not two. one. π€
ok and that's literally the whole page bestie, every flag accounted for, nothing skipped, no notes π
and that's a wrap on ngramsort version 1.3.17, dated February 2022 π thanks for coming to my ted talk, go sort some ngrams, i'm obsessed with you, bye!! π
β¨π¦
π¦ where this page comes from
- fedora 44: opengrm-ngram-tools 1.3.17-2.fc44 Β· Apache-2.0
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms