Sympa::WWW::Crawlers(3Sympa)

📦
version 6.2.80 · 10 versions
, in fedora 43, fedora 44

💖 Sympa::WWW::Crawlers 💖

okay bestie, this is a page from the sympa 6.2.80 manual, and it's literally all about Sympa::WWW::Crawlers(3Sympa). tiny page, big purpose. sit down, grab a strawberry 🍓, let's go.

✨ NAME ✨

Sympa::WWW::Crawlers — Regular expression for User-Agent of web crawlers 🕷️

🌸 DESCRIPTION 🌸

So. This module is the place where Sympa keeps the definition of the regular expressions it uses. That's the whole vibe.

And lowkey the most iconic part: the regular expression is generated from the data provided by the project below. She's not hand-crafted, she's derived. 💅

🦋 SEE ALSO 🦋

  • Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders — yes that is the actual title and no we did not shorten it, it ate and left no crumbs 👑

<https://github.com/monperrus/crawler-user-agents> ✨

📜 HISTORY 📜

storytime, bestie, because this feature has lore 🔥

  • Crawler detection feature of WWSympa was introduced on Sympa 5.4a.4, and back then it derives information provided by <http://www.useragentstring.com>.
  • Then on Sympa 6.2.74, it got replaced with regular expression matching using information provided by crawler-user-agents project above. glow-up fr fr 💅✨
not me being emotionally attached to a changelog. anyway. 🙈

and that's the whole page, my love 🫶 this was Sympa::WWW::Crawlers(3Sympa) from sympa 6.2.80, dated 2026-10-19. periodt. 💖🎀🦋

📦 where this page comes from