unicode(n)

💖 unicode(n) — Unicode normalization, but make it iconic 💖

okay bestie, sit down, we're doing Unicode normalization today and honestly? it's giving main character energy. this is the unicode manual page from tcllib, section n, and it is literally the implementation of Unicode normalization forms in Tcl. no cap.

---

✨ SYNOPSIS ✨

package require Tcl 8.5 9

package require unicode 1.1.1

::unicode::fromstring string

::unicode::tostring uclist

::unicode::normalize form uclist

::unicode::normalizeS form string

so first you gotta package require Tcl 8.5 9, then package require unicode 1.1.1, and then you have four little besties to play with 🫶

---

🌸 DESCRIPTION 🌸

this is an implementation in Tcl of the Unicode normalization forms. that's it, that's the vibe. it normalizes. it's Unicode. it slays. 💅

---

👑 COMMANDS 👑

🦋 ::unicode::fromstring string

converts string to a list of integer Unicode character codes — which is the format unicode uses for its internal string representation. so like, you hand it a cute little string, it hands you back the numbers. glow up moment ✨

🦋 ::unicode::tostring uclist

converts a list of integers uclist back to a Tcl string. it's the reverse glow-down. the numbers become words again. iconic.

🦋 ::unicode::normalize form uclist

normalizes the Unicode characters list ulist according to form, and returns the normalized list. so what can form be, you ask? bestie, exactly four things:

• D — canonical decomposition
• C — canonical decomposition, followed by canonical composition
• KD — compatibility decomposition
• KC — compatibility decomposition, followed by canonical composition

periodt. those are the only four. don't try to be creative. 🙈

🦋 ::unicode::normalizeS form string

this one is a shortcut, and honestly it's the lazy-girl boss move. it's literally:

::unicode::tostring [unicode::normalize $form [::unicode::fromstring $string]]

it normalizes a Tcl string and returns a normalized string. no list of integers in between, no extra steps, just vibes and results. 🔥

---

🎀 EXAMPLES 🎀

watch and learn, bestie:

% ::unicode::fromstring "\u0410\u0411\u0412\u0413"
1040 1041 1042 1043
% ::unicode::tostring {49 50 51 52 53}
12345
%

% ::unicode::normalize D {7692 775}
68 803 775
% ::unicode::normalizeS KD "\u1d2c"
A
%

see how \u1d2c just became a whole entire A? that's the compatibility decomposition doing its thing. ate. 💅

---

📚 REFERENCES 📚

1. "Unicode Standard Annex #15: Unicode Normalization Forms", (http://unicode.org/reports/tr15/)

go read it, it's the source material, the lore, the origin story. 🧚

---

⭐ AUTHORS ⭐

Sergei Golovan. thank you king, we appreciate you. 👑

---

💀 BUGS, IDEAS, FEEDBACK 💀

ngl, this document and the package it describes will undoubtedly contain bugs and other problems. that's just how software is, bestie. no shame.

• please report such in the category stringprep of the Tcllib Trackers [http://core.tcl.tk/tcllib/reportlist]
• please also report any ideas for enhancements you may have for either package and/or documentation

when proposing code changes, please provide unified diffs, i.e the output of diff -u.

also, heads up: attachments are strongly preferred over inlined patches. attachments can be made by going to the Edit form of the ticket immediately after its creation, and then using the left-most button in the secondary navigation bar. yes, that's a lot of steps, but it's the way. 😭

---

🌈 SEE ALSO 🌈

• stringprep(n)

---

🍓 KEYWORDS 🍓

• normalization
• unicode

---

💜 COPYRIGHT 💜

Copyright (c) 2007, Sergei Golovan <sgolovan@nes.ru>

---

and that's the whole page, bestie!! this one came from tcllib, version 1.1.1 — the unicode(n) page, written up all cute just for you. now go normalize something and be free 🦋✨💖