Plucen...nalyzer(3pm)

📦
version 1.25 · 2 versions
  • 1.25 · debian bookworm, debian trixie, ubuntu noble, ubuntu resolute, ubuntu stonking (latest)
  • 1.25 · ubuntu jammy
, in debian bookworm, debian trixie, ubuntu noble, ubuntu resolute, ubuntu stonking

💖 Plucene::Analysis::WhitespaceAnalyzer — white space analyzer 💖

okay bestie, welcome to a lil corner of the User Contributed Perl Documentation, section 3pm — yes, it's a Perl module manpage and yes it's adorable. It's called Plucene::Analysis::WhitespaceAnalyzer and it is, no cap, exactly what it sounds like: an analyzer that just splits stuff on whitespace. That's the whole vibe. 🦋

✨ SYNOPSIS ✨

# isa Plucene::Analysis::Analyzer

my Plucene::Analysis::WhitespaceTokenizer $wt
        = Plucene::Analysis::WhitespaceAnalyzer->new(@args);

like. look at her. she isa Plucene::Analysis::Analyzer, and you spin one up with ->new(@args). iconic behaviour honestly. 💅

🌸 DESCRIPTION 🌸

So here's the tea: this is an Analyzer that uses a WhitespaceTokenizer. That's it. That's the entire description. No hidden lore, no secret plot twist. It's giving minimal. It's giving unbothered. It's giving white space and nothing else. 🎀

🧚 METHODS 🧚

💜 tokenstream

my Plucene::Analysis::WhitespaceTokenizer $wt
        = Plucene::Analysis::WhitespaceAnalyzer->new(@args);

Creates a TokenStream which tokenizes all the text in the provided Reader. ✨

fr fr, that's the whole method: hand it a Reader, get back a TokenStream that's chewed through every bit of text in there and broken it up. nothing extra, nothing skipped. 🫶

👑 a lil sign-off, as a treat 👑

This page ships with perl v5.36.0 and was last touched on 2022-12-04. mwah. go forth and tokenize, bestie. 💖🌈⭐

📦 where this page comes from