NGRAMREAD(1)
β¨ NAME β¨
ngramread β bestie, this is the manual page for ngramread 1.3.17 π
π¦ DESCRIPTION π¦
okay so real talk: ngramread takes text formats and transforms them into FSTs. that's the whole vibe. it's giving glow-up-for-your-data β¨
here's the usage, no cap:
Usage: ngramread [--options] [in.txt [out.fst]]
and now, the flags. buckle up, there's a lot, but every single one is here because i would never do you like that π«Ά
πΈ PROGRAM FLAGS πΈ
--ARPAβ type =bool, default =false. read the model from ARPA format.--OOV_symbolβ type =std::string, default ="<UNK>". the class label for OOV symbols.--epsilon_symbolβ type =std::string, default ="<epsilon>". the label for epsilon transitions.--renormalize_arpaβ type =bool, default =false. if true, it attempts to renormalize an unnormalized ARPA format model by normalizing the unigram state and recomputing the backoff weights. only used if--ARPA=true, iykyk.--symbolsβ type =std::string, default ="". label symbol table.
π LIBRARY FLAGS π
π Flags from: flags.cc
--helpβ type =bool, default =false. show usage information.--helpshortβ type =bool, default =false. show brief usage information.--tmpdirβ type =std::string, default ="/tmp". temporary directory.--vβ type =int32_t, default =0. verbosity level.
π Flags from: fst.cc
--fst_alignβ type =bool, default =false. write FST data aligned where appropriate.--fst_default_cache_gcβ type =bool, default =true. enable garbage collection of cache.--fst_default_cache_gc_limitβ type =int64_t, default =1048576. the cache byte size that triggers garbage collection.--fst_read_modeβ type =std::string, default ="read". default file reading mode for mappable files.--fst_verify_propertiesβ type =bool, default =false. verify FST properties queried by TestProperties.--save_relabel_ipairsβ type =std::string, default ="". save input relabel pairs to file.--save_relabel_opairsβ type =std::string, default ="". save output relabel pairs to file.
π Flags from: ngram-output.cc
--end_symbolβ type =std::string, default ="</s>". class label for sentence end.--start_symbolβ type =std::string, default ="<s>". class label for sentence start.
π Flags from: symbol-table.cc
--fst_compat_symbolsβ type =bool, default =true. require symbol tables to match when appropriate.--fst_field_separatorβ type =std::string, default =" ". the set of characters used as a separator between printed fields.
π Flags from: util.cc
--fst_error_fatalβ type =bool, default =true. FST errors are fatal; o.w. return objects flagged as bad: e.g., FSTs:kErrorproperty set, FST weights: not aMember().--ngram_error_fatalβ type =bool, default =true. NGram errors are fatal if true; otherwise returns objects flagged as bad: e.g.,NGramModel::Error()is true.
π Flags from: weight.cc
--fst_weight_parenthesesβ type =std::string, default ="". characters enclosing the first weight of a printed composite weight (e.g., pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size0(none) or2(open and close parenthesis).--fst_weight_separatorβ type =std::string, default =",". character separator between printed composite weights; must be a single character.
and that's the whole page, bestie. every flag, every default, every little detail β not me gatekeeping anything π
this was ngramread 1.3.17, dated February 2022. periodt. π
β¨
π¦ where this page comes from
- fedora 44: opengrm-ngram-tools 1.3.17-2.fc44 Β· Apache-2.0
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms