TMX-TOKENIZE(1p)

📦
version 0.39 · 3 versions
, in debian trixie, ubuntu resolute, ubuntu stonking

✨ NAME ✨

okay so this is tmx-tokenize — a lil command-line bestie from the User Contributed Perl Documentation section (manual page TMX-TOKENIZE(1p), iykyk 💅). What does it do? It tokenizes translation units on a tmx file. that's it, that's the whole vibe 🎀

🌸 VERSION 🌸

this one's rockin' version 0.39 — periodt ✨

🦋 SYNOPSIS 🦋

the two iconic ways to run her:

tmx-tokenize file.tmx  # creates t_file.tmx

tmx-tokenize -o=out.tmx file.tmx

like... run it on a file, it makes t_file.tmx for you. or tell it exactly where you want the output with -o=out.tmx and it does that instead. main character energy fr fr 👑

💖 DESCRIPTION 💖

so here's the tea ☕ — even though this script comes bundled inside XML::TMX, it's got a soft dependency on Lingua::FreeLing3. soft means the dependency is not guaranteed at install time, and you can still use all the other features of the module without Lingua::FreeLing3 ever showing up. ngl, so chill of it.

but bestie... if you actually wanna use this tool, you should install that module. no cap. 🙈

right now, the supported languages are exactly the ones FreeLing3 supports, and the list is:

  • English 🇬🇧
  • Spanish 🇪🇸
  • Russian 🇷🇺
  • Portuguese 🇵🇹
  • Italian 🇮🇹

if your TMX file has any other language in it, those get maintained without a change — untouched, unbothered, thriving 🧚

and just so you know, this behavior can change in the future, because a basic regexp based tokenizer might get implemented. so like, don't build your whole personality on it staying the same 💀

🔥 SEE ALSO 🔥

go read these too, they're literally so good:

  • XML::TMX
  • Lingua::FreeLing3

👑 AUTHORS 👑

the icons who made this happen:

  • Alberto Simões <ambs@cpan.org>
  • José João Almeida <jj@di.uminho.pt>

This software is copyright (c) 2010-2017 by Projeto Natura <natura@di.uminho.pt>. 🩷

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself. slay, legally speaking ✨

and that's the whole page, bestie — manual TMX-TOKENIZE(1p), brought to you by perl v5.38.2, dated 2024-03-09. mwah 💅💖

📦 where this page comes from