Plucen...enizer(3pm)

💖 Plucene::Analysis::WhitespaceTokenizer(3pm) 💖

okay bestie, welcome to the Perl User Contributed Documentation section, we're diving into Plucene::Analysis::WhitespaceTokenizer and honestly? it's giving short-and-iconic. let's go 🦋

---

✨ NAME ✨

Plucene::Analysis::WhitespaceTokenizer — the white space tokenizer, periodt 💅

---

✨ SYNOPSIS ✨

        # isa Plucene::Analysis::CharTokenizer

that's it. that's the whole synopsis. no cap, it just inherits from Plucene::Analysis::CharTokenizer and lives its life 🎀

---

✨ DESCRIPTION ✨

so here's the tea ☕ — a WhitespaceTokenizer is a tokenizer that divides text at whitespace. literally just cuts it up whenever it hits whitespace.

and adjacent sequences of non-Whitespace characters? those form tokens. that's the whole vibe. no punctuation drama, no lowercase-ing, no nothing — just vibes and spaces ✨

---

✨ METHODS ✨

ngl bestie, this section is empty in the original. no methods are documented here. the tokenizing magic is all inherited from Plucene::Analysis::CharTokenizer, so go check that page if you wanna know the mechanics 🫶

---

💀 lowkey the shortest manpage I've ever read and I'm obsessed with her for it.

---

k bye, this was Perl v5.36.0, dated 2022-12-04, and that's the whole page, mwah 💖✨