NGRAMSORT(1)

πŸ“¦
version 1.3.17 Β· 3 versions
, in fedora 44

✨ NGRAMSORT β€” the ngramsort(1) glow-up ✨

okay bestie, pull up a chair, we're sorting ngrams and we're gonna look cute doing it πŸ’…


🌸 NAME 🌸

ngramsort β€” literally the manual page for ngramsort version 1.3.17, no cap


πŸ¦‹ DESCRIPTION πŸ¦‹

So here's the vibe: it sorts an ngram LM in lexicographic state context order. That's it. That's the whole job. She's a one-trick pony and she ate. πŸ‘‘

Usage, and yes you're gonna wanna memorize this:

ngramsort [--options] [in.fst [out.fst]]

πŸ’œ PROGRAM FLAGS πŸ’œ

these are her flags, the ones that belong to ngramsort herself πŸŽ€

  • --backoff_label β€” type = int64_t, default = 0. This one's the backoff label. iconic.
  • --check_consistency β€” type = bool, default = false. Checks the model's consistency for you. she's thorough like that 🫢
  • --norm_eps β€” type = double, default = 0.001. The normalization check epsilon. tiny little number, big responsibilities ⭐

🌈 LIBRARY FLAGS 🌈

these ones come from the library, they're the shared friend group πŸ’–

πŸŽ€ Flags from: flags.cc

  • --help β€” type = bool, default = false. Shows usage information. bestie behaviour fr fr
  • --helpshort β€” type = bool, default = false. Shows brief usage information. the tl;dr version 😌
  • --tmpdir β€” type = std::string, default = "/tmp". The temporary directory. that's where the chaos lives πŸ’€
  • --v β€” type = int32_t, default = 0. Verbosity level. turn it up if you wanna hear her yap πŸ”₯

πŸ¦‹ Flags from: fst.cc

  • --fst_align β€” type = bool, default = false. Writes FST data aligned where appropriate. alignment? slay ✨
  • --fst_default_cache_gc β€” type = bool, default = true. Enables garbage collection of the cache. she cleans up after herself, we love a tidy queen 🧹
  • --fst_default_cache_gc_limit β€” type = int64_t, default = 1048576. The cache byte size that triggers garbage collection. one million forty-eight thousand five hundred seventy-six bytes and then she starts tidying πŸŽ€
  • --fst_read_mode β€” type = std::string, default = "read". Default file reading mode for mappable files.
  • --fst_verify_properties β€” type = bool, default = false. Verify FST properties queried by TestProperties. she checks receipts 🧾
  • --save_relabel_ipairs β€” type = std::string, default = "". Save input relabel pairs to file.
  • --save_relabel_opairs β€” type = std::string, default = "". Save output relabel pairs to file.

🌸 Flags from: symbol-table.cc

  • --fst_compat_symbols β€” type = bool, default = true. Requires symbol tables to match when appropriate. compatibility check, periodt πŸ’…
  • --fst_field_separator β€” type = std::string, default = " ". The set of characters used as a separator between printed fields. yes that default is a whole bunch of whitespace, don't perceive it, just accept it 😭

πŸ’– Flags from: util.cc

  • --fst_error_fatal β€” type = bool, default = true. FST errors are fatal; o.w. return objects flagged as bad: e.g., FSTs: kError property set, FST weights: not a Member(). so like, either she panics or she hands you back something marked as bad. dramatic either way πŸ™ˆ

πŸ‘‘ Flags from: weight.cc

  • --fst_weight_parentheses β€” type = std::string, default = "". Characters enclosing the first weight of a printed composite weight (e.g., pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size 0 (none) or 2 (open and close parenthesis). so it's giving all or nothing, and honestly? same πŸ’€
  • --fst_weight_separator β€” type = std::string, default = ",". Character separator between printed composite weights; must be a single character. exactly one. not two. one. 😀

ok and that's literally the whole page bestie, every flag accounted for, nothing skipped, no notes πŸ’–

and that's a wrap on ngramsort version 1.3.17, dated February 2022 πŸŽ€ thanks for coming to my ted talk, go sort some ngrams, i'm obsessed with you, bye!! πŸ’…βœ¨πŸ¦‹

πŸ“¦ where this page comes from