OMORFI-TOKENISE(1)

πŸ“¦ version 0.9.9, in nixos 26.05, nixpkgs unstable

πŸ’– omorfi-tokenise β€” OMORFI-TOKENISE(1) πŸ’–

bestie, welcome to the User Commands manual page for omorfi-tokenise β€” the Finnish text tokeniser from omorfi. It’s giving β€œsplit it, bestie” energy ✨


🌸 NAME 🌸

omorfi-tokenise β€” Tokenise Finnish text using omorfi

πŸ¦‹ SYNOPSIS πŸ¦‹

omorfi-tokenise.bash [OPTION] [FILENAME...]

πŸ’… DESCRIPTION πŸ’…

It tokenises Finnish text using omorfi, splitting punctuation off from words where possible based on the morphological dictionary.

okay so the flags are literally:

  • -h, --help β€” prints this help dialog
  • -V, --version β€” prints version info
  • -v, --verbose β€” prints verbosely while processing
  • -X, --all-words β€” uses the large-coverage dictionary

If no FILENAMEs are given, input is read from standard input.

πŸŽ€ EXAMPLE πŸŽ€

Tokenise a text:

omorfi-tokenise.bash test.text

Copyright Β© 2018 Tommi A Pirinen Licence GPLv3: GNU GPL version 3 <http://gnu.org/licenses/gpl.html>

This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.


source/version: OMORFI Β· date: June 2018 Β· bye bestie, mwah πŸ’‹πŸ‘‘

πŸ“¦ where this page comes from