NGRAMMAKE(1)
β¨ NAME β¨
okay bestie, meet ngrammake β it's the User Commands girlie whose manual page you're reading rn, and she's serving version 1.3.17 π
πΈ DESCRIPTION πΈ
She makes an n-gram model out of an input count file. That's the whole vibe. That's her job. And she eats every time. π
Usage, copy it exactly bestie:
ngrammake [--options] [in.fst [out.fst]]
π¦ PROGRAM FLAGS π¦
these are her flags, the ones that actually change what kind of model you get. read them. love them. π
--backoffβ type =bool, default =false. Turn on backoff smoothing. (Default is method dependent, so likeβ¦ it depends on your method, iykyk.)--backoff_labelβ type =int64_t, default =0. The backoff label. that's it, that's the flag. π--binsβ type =int64_t, default =-1. How many bins for katz or absolute discounting.--check_consistencyβ type =bool, default =false. Check that your model is consistent. vibe check for your model, fr.--count_of_countsβ type =std::string, default ="". Read the count-of-counts from a file.--discount_Dβ type =double, default =-1. The absolute discount valueDto use.--interpolateβ type =bool, default =false. Use interpolated smoothing. (Default is method dependent again, bestie, she keeps it mysterious.)--methodβ type =std::string, default ="katz". One of:"absolute","katz","kneser_ney","presmoothed","unsmoothed","katz_frac","witten_bell". pick your fighter π--norm_epsβ type =double, default =0.001. The normalization check epsilon.--witten_bell_kβ type =double, default =1. The Witten-Bell hyperparameterK.
π LIBRARY FLAGS π
these ones come from the library itself, not from the main program. still iconic, still matters. π«Ά
β Flags from: flags.cc
--helpβ type =bool, default =false. Show usage information.--helpshortβ type =bool, default =false. Show brief usage information.--tmpdirβ type =std::string, default ="/tmp". Temporary directory.--vβ type =int32_t, default =0. Verbosity level.
β Flags from: fst.cc
--fst_alignβ type =bool, default =false. Write FST data aligned where appropriate.--fst_default_cache_gcβ type =bool, default =true. Enable garbage collection of the cache. (yes bestie, it's on by default, she's tidy.)--fst_default_cache_gc_limitβ type =int64_t, default =1048576. The cache byte size that triggers garbage collection.--fst_read_modeβ type =std::string, default ="read". Default file reading mode for mappable files.--fst_verify_propertiesβ type =bool, default =false. Verify FST properties queried byTestProperties.--save_relabel_ipairsβ type =std::string, default ="". Save input relabel pairs to a file.--save_relabel_opairsβ type =std::string, default ="". Save output relabel pairs to a file.
β Flags from: ngram-output.cc
--end_symbolβ type =std::string, default ="</s>". Class label for sentence end.--start_symbolβ type =std::string, default ="<s>". Class label for sentence start.
β Flags from: symbol-table.cc
--fst_compat_symbolsβ type =bool, default =true. Require symbol tables to match when appropriate.--fst_field_separatorβ type =std::string, default =" ". Set of characters used as a separator between printed fields.
β Flags from: util.cc
--fst_error_fatalβ type =bool, default =true. FST errors are fatal; o.w. return objects flagged as bad: e.g., FSTs:kErrorproperty set, FST weights: not aMember().--ngram_error_fatalβ type =bool, default =true. NGram errors are fatal if true; otherwise returns objects flagged as bad: e.g.,NGramModel::Error()is true.
β Flags from: weight.cc
--fst_weight_parenthesesβ type =std::string, default ="". Characters enclosing the first weight of a printed composite weight (e.g., pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size0(none) or2(open and close parenthesis).--fst_weight_separatorβ type =std::string, default =",". Character separator between printed composite weights; must be a single character.
no cap on the last two: those size rules are real and she will be dramatic about it.--fst_weight_parentheseshas to be size0or2, and--fst_weight_separatorhas to be exactly one character. periodt. π
and that's the whole page, bestie!! go make some n-grams and slay π
ngrammake version 1.3.17, dated February 2022 β that's the source and the date, signed off with a π¦ and a little curtsy. bye pookie!! β¨
π¦ where this page comes from
- fedora 44: opengrm-ngram-tools 1.3.17-2.fc44 Β· Apache-2.0
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms