unicode(3tcl)

💖 unicode — the normalization glow-up 💖

okay bestie, so this is unicode(3tcl) — the Tcl manual page all about Unicode normalization ✨ and ngl it's lowkey iconic. it lives in tcllib and it's here to make your strings behave. let's get into it 🫶

---

✨ NAME ✨

unicode — implementation of Unicode normalization 💅

---

🌸 SYNOPSIS 🌸

package require Tcl 8.5 9

package require unicode 1.1.1

::unicode::fromstring string

::unicode::tostring uclist

::unicode::normalize form uclist

::unicode::normalizeS form string

like, that's the whole vibe right there 👑

---

🦋 DESCRIPTION 🦋

this is an implementation in Tcl of the Unicode normalization forms. that's it, that's the whole thing. no cap 🎀

---

💅 COMMANDS 💅

the main character energy lives here fr fr:

• ::unicode::fromstring string — takes string and converts it into a list of integer Unicode character codes, which is what unicode uses for its internal string representation. so like, the ✨real✨ form of your string.
• ::unicode::tostring uclist — the glow-down (but in a good way): converts that list of integers uclist back into a Tcl string. reverse uno card 🃏
• ::unicode::normalize form uclist — normalizes the Unicode characters list ulist according to form, and hands you back the normalized list. and form can be one of these four:
  • D — canonical decomposition
  • C — canonical decomposition, followed by canonical composition
  • KD — compatibility decomposition
  • KC — compatibility decomposition, followed by canonical composition
• ::unicode::normalizeS form string — the shortcut bestie!! it's literally just ::unicode::tostring [unicode::normalize $form [::unicode::fromstring $string]]. normalizes a Tcl string and returns the normalized string. normalize + string = normalizeS, iykyk 🌈

---

🔥 EXAMPLES 🔥

watch and learn, this is the tutorial arc:

% ::unicode::fromstring "\u0410\u0411\u0412\u0413"
1040 1041 1042 1043
% ::unicode::tostring {49 50 51 52 53}
12345
%

% ::unicode::normalize D {7692 775}
68 803 775
% ::unicode::normalizeS KD "\u1d2c"
A
%

see?? it just works. slay 💅

---

⭐ REFERENCES ⭐

1. "Unicode Standard Annex #15: Unicode Normalization Forms", (http://unicode.org/reports/tr15/)

---

👑 AUTHORS 👑

Sergei Golovan

---

💀 BUGS, IDEAS, FEEDBACK 💀

okay so real talk — this document, and the package it describes, will undoubtedly contain bugs and other problems. like, guaranteed. so please report them in the category stringprep of the Tcllib Trackers at http://core.tcl.tk/tcllib/reportlist. and if you've got ideas for enhancements for either the package and/or the documentation, pls also drop those 💖

when proposing code changes, please provide unified diffs, i.e the output of diff -u.

also note further that attachments are strongly preferred over inlined patches. attachments can be made by going to the Edit form of the ticket immediately after its creation, and then using the left-most button in the secondary navigation bar. that's the move 🙈

---

🧚 SEE ALSO 🧚

stringprep(3tcl)

---

🍓 KEYWORDS 🍓

normalization, unicode

---

💜 COPYRIGHT 💜

Copyright (c) 2007, Sergei Golovan <sgolovan@nes.ru>

---

and that's a wrap bestie!! this page came to you from tcllib, version 1.1.1, and the manual page is dated unicode(3tcl) ✨ mwah, go normalize something, you got this 🎀💖