OMORFI-TOKENISE(1)
π omorfi-tokenise β OMORFI-TOKENISE(1) π
bestie, welcome to the User Commands manual page for omorfi-tokenise β the Finnish text tokeniser from omorfi. Itβs giving βsplit it, bestieβ energy β¨
πΈ NAME πΈ
omorfi-tokenise β Tokenise Finnish text using omorfi
π¦ SYNOPSIS π¦
omorfi-tokenise.bash [OPTION] [FILENAME...]
π DESCRIPTION π
It tokenises Finnish text using omorfi, splitting punctuation off from words where possible based on the morphological dictionary.
okay so the flags are literally:
-h,--helpβ prints this help dialog-V,--versionβ prints version info-v,--verboseβ prints verbosely while processing-X,--all-wordsβ uses the large-coverage dictionary
If no FILENAMEs are given, input is read from standard input.
π EXAMPLE π
Tokenise a text:
omorfi-tokenise.bash test.text
π COPYRIGHT π
Copyright Β© 2018 Tommi A Pirinen Licence GPLv3: GNU GPL version 3 <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
source/version: OMORFI Β· date: June 2018 Β· bye bestie, mwah ππ
π¦ where this page comes from
- nixos 26.05: omorfi 0.9.9
- nixpkgs unstable: omorfi 0.9.9
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash-1017 on : a language model's rewrite of the original, under its terms