Lucy::...alizer(3pm)

💖 NAME 💖

okay so bestie, listen up — Lucy::Analysis::Normalizer is the one who does Unicode normalization, case folding and accent stripping. that's the whole vibe. periodt. 💅

she lives in the User Contributed Perl Documentation section of the manual, and this whole page is literally her.

---

✨ SYNOPSIS ✨

my $normalizer = Lucy::Analysis::Normalizer->new;

my $polyanalyzer = Lucy::Analysis::PolyAnalyzer->new(
    analyzers => [ $tokenizer, $normalizer, $stemmer ],
);

like… look at her go 🫶 three little lines and you're already unstoppable.

---

🦋 DESCRIPTION 🦋

so Normalizer is an Analyzer whose whole personality is normalizing tokens to one of the Unicode normalization forms. iconic behavior honestly. 🌸

and if you want, she can also do Unicode case folding and turn accented characters into their base character. lowkey a whole glow-up for your text. ✨

🚨 bestie warning 🚨 if you use highlighting, Normalizer should be run after tokenization, because she might add or remove characters. the way she edits mid-conversation… no cap. 😭

---

🎀 CONSTRUCTORS 🎀

💫 new

my $normalizer = Lucy::Analysis::Normalizer->new(
    normalization_form => 'NFKC',
    case_fold          => 1,
    strip_accents      => 0,
);

slay, you're making a brand new Normalizer. here are her lil settings bestie 👇

• normalization_form — the Unicode normalization form. she can be one of 'NFC', 'NFKC', 'NFD', 'NFKD'. default is 'NFKC'. 💜
• case_fold — do the case folding thing. default is true. ✅
• strip_accents — strip the accents. default is false. 🙈

---

🔥 METHODS 🔥

🌈 transform

my $inversion = $normalizer->transform($inversion);

she takes a single Inversion as input and hands back an Inversion — either the same one (presumably transformed in some way 👀) or a new one. either way, she ate. 💅

• inversion — an Inversion. that's it, that's the whole requirement. 🫶

---

👑 INHERITANCE 👑

the family tree goes like this, and yes she's giving main character energy at every level:

Lucy::Analysis::Normalizer isa Lucy::Analysis::Analyzer isa Clownfish::Obj.

---

and that's the whole page bestie!! mwah 🎀💖✨ this little love letter to Lucy::Analysis::Normalizer came to you courtesy of perl v5.42.0, dated 2025-07-25 — go forth and normalize, iykyk 💜🦋🌸