NGRAMMARGINALIZE(1)
π NAME π
ngrammarginalize β the manual page for ngrammarginalize 1.3.17, bestie. Yes it's a whole command, yes it's iconic, let's go π
β¨ DESCRIPTION β¨
Okay so the entire serve here is: it marginalizes an n-gram model, and it pulls that model straight out of the input model file. That's the job. That's the assignment. Periodt. π¦
Usage: ngrammarginalize [--options] [in.fst [out.fst]]
πΈ PROGRAM FLAGS πΈ
These are the flags that belong to the program itself, the main character energy flags, if you will π₯
--backoff_labelβ type =int64_t, default =0. This is the backoff label, bestie.--check_consistencyβ type =bool, default =false. Check the model's consistency. vibe check the whole model fr fr.--max_bo_updatesβ type =int32_t, default =10. Max iterations of backoff re-calculation.--norm_epsβ type =double, default =0.001. Normalization check epsilon.
π LIBRARY FLAGS π
π Flags from: flags.cc π
--helpβ type =bool, default =false. Show usage information.--helpshortβ type =bool, default =false. Show brief usage information.--tmpdirβ type =std::string, default ="/tmp". The temporary directory.--vβ type =int32_t, default =0. Verbosity level.
π Flags from: fst.cc π
--fst_alignβ type =bool, default =false. Write FST data aligned where appropriate.--fst_default_cache_gcβ type =bool, default =true. Enable garbage collection of cache.--fst_default_cache_gc_limitβ type =int64_t, default =1048576. Cache byte size that triggers garbage collection.--fst_read_modeβ type =std::string, default ="read". Default file reading mode for mappable files.--fst_verify_propertiesβ type =bool, default =false. Verify FST properties queried byTestProperties.--save_relabel_ipairsβ type =std::string, default ="". Save input relabel pairs to file.--save_relabel_opairsβ type =std::string, default ="". Save output relabel pairs to file.
π Flags from: ngram-output.cc π
--end_symbolβ type =std::string, default ="</s>". Class label for sentence end.--start_symbolβ type =std::string, default ="<s>". Class label for sentence start.
π Flags from: symbol-table.cc π
--fst_compat_symbolsβ type =bool, default =true. Require symbol tables to match when appropriate.--fst_field_separatorβ type =std::string, default =" ". Set of characters used as a separator between printed fields.
π Flags from: util.cc π
--fst_error_fatalβ type =bool, default =true. FST errors are fatal; o.w. return objects flagged as bad: e.g., FSTs:kErrorproperty set, FST weights: not aMember(). So like, either everything dies dramatically or you get back something marked as bad. Pick your fighter π--ngram_error_fatalβ type =bool, default =true. NGram errors are fatal if true; otherwise returns objects flagged as bad: e.g.,NGramModel::Error()is true.
π Flags from: weight.cc π
--fst_weight_parenthesesβ type =std::string, default ="". Characters enclosing the first weight of a printed composite weight (e.g., pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size0(none) or2(open and close parenthesis).--fst_weight_separatorβ type =std::string, default =",". Character separator between printed composite weights; must be a single character.
And that's the whole page, bestie!! π«Ά ngrammarginalize 1.3.17, February 2022 β go forth and marginalize those n-grams, you absolute icon π
π¦ where this page comes from
- fedora 44: opengrm-ngram-tools 1.3.17-2.fc44 Β· Apache-2.0
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms