CHASEN(1)

πŸ’– CHASEN β€” Japanese Morphological Analysis System πŸ’–

okay bestie, sit down, hydrate, and let me tell you about chasen, a whole morphological analysis system from the General Commands Manual, section 1. she's iconic, she's academic, she segments Japanese text and she does NOT miss. let's go πŸŽ€


✨ SYNOPSIS ✨

chasen [options] file

🌸 DESCRIPTION 🌸

so like, chasen is a morphological analysis system. what does that mean for us? it can segment and tokenize a Japanese text string, and it can output that with a TON of extra info attached β€” pronunciation, semantic information, and others. it's giving linguist main character energy fr fr 🧚

and the way it works? it prints the result of all that to standard output, so you can either write it to a file or keep processing it downstream. flexible queen behavior πŸ’…


πŸ‘‘ OPTIONS πŸ‘‘

here's the full roster, no skips, no cuts, we respect every flag in this house 🫢

  • -s β€” use partial sentence mode for analysis.
  • -j β€” use Japanese sentence mode for analysis. KUTEN (including other puncuation marks) and empty line are treated as the punctuation of the text.
  • -C β€” use the command mode for analysis.
  • -b β€” show the best path. (this one's the default, she's the baseline πŸ’–)
  • -m β€” show all morphemes where ambiguity is identified in the best path.
  • -p β€” show all paths expanding for all combinations of the ambiguity. (all of them. every single one. brace yourself 😭)
  • -f β€” show formatted morpheme data in column. (default ✨)
  • -e β€” show entire morpheme data.
  • -c β€” show coded morpheme data.
  • -d β€” show detailed morpheme for use by Prolog.
  • -v β€” show detailed morpheme for use by VisualMorphs.
  • -O[c|s] β€” show morpheme as compound words or their segments.
  • -F format β€” show morpheme formatted by the format such as "%m\t%y\t%M\t%U(%P-)\t%T \t%F \n" .
  • -Fh β€” print help information for -F option.
  • -i lang β€” specify the character encoding of the input file. e: EUC-JP, s:Shift JIS, w:UTF-8, u:UTF-8, a:ISO-8859-1
  • -o file β€” specify the output file to be file .
  • -w width β€” specify the cost width.
  • -r rcfile β€” use rcfile as the chasenrc file.
  • -R β€” use the system default chasenrc file (/etc/chasenrc).
  • -L lang β€” specify language.
  • -lp β€” print the list of parts of speech (hinshi).
  • -lt β€” print list of conjugation types.
  • -lf β€” print list of conjugation forms.
  • -h β€” print help.
  • -V β€” print ChaSen version number.
🫢 quick note bestie: this manual page was written for the Debian GNU/Linux distribution because the original program does not have a manual page. no cap.

πŸ”₯ SEE ALSO πŸ”₯

the programs are documented fully by /usr/share/doc/chasen/manual‐j.tex or /usr/share/doc/chasen/manual‐j.pdf. go read the real thing if you want the deep lore πŸ“š


πŸ’œ AUTHOR πŸ’œ

this manual page was written by Takao KAWAMURA <kawamura@debian.or.jp> and modified by Hideki Yamane <henrich@debian.or.jp> and Osamu Aoki <osamu@debian.org> for the Debian GNU/Linux system (but may be used by others). legends, honestly πŸ‘‘


okay that's the whole page!! this was CHASEN(1) from the General Commands Manual, and if you ever need her again just yell for CHASEN(1) and she'll show up. mwah, go tokenize something beautiful πŸ’–βœ¨πŸŽ€