TWEEPER(1)

πŸ“¦
version 1.4.3 Β· 3 versions
, in debian bookworm, ubuntu jammy, ubuntu noble

πŸ’– TWEEPER(1) πŸ’–

okay bestie, sit down, because this one is so good β€” it's the manual page for tweeper, and I'm gonna walk you through every single crumb of it πŸ“


✨ NAME ✨

tweeper β€” a web scraper that converts supported websites (like, say, Twitter.com πŸ‘€) into RSS


🌸 SYNOPSIS 🌸

tweeper [OPTIONS] URL

that's it. that's the whole vibe. one URL, some options, go πŸ’…


πŸ¦‹ DESCRIPTION πŸ¦‹

so tweeper(1) is a web scraper, and the whole point of it is that you can follow the public activity of social network users without logging in and without even being subscribed to the social network. not me being a ghost in the group chat 😭 it just takes that public info and converts it to RSS so your feed reader can grab it and collect it. iconic behaviour.

fun fact bestie: tweeper started life as the TWitter fEEd scraPER (the way that acronym ate 🫢), but support for other sites got added over time.

the sites tweeper can scrape and turn into RSS are:

  • Twitter.com
  • Pump.io based websites, like Identi.ca
  • Dilbert.com
  • Instagram.com
  • Facebook.com (public pages)

and you can use tweeper as:

  1. a command line tool
  2. a filter for feed readers
  3. a web based tool when you use it with a PHP-enabled web server

like?? multitasking queen πŸ‘‘


πŸ’… OPTIONS πŸ’…

  • -e β€” show links to supported media files in the RSS <enclosure/> element
  • -m <0|1> β€” turn showing multimedia content (e.g. Twitter or Instagram pictures) directly inside the item description on or off. default is 1 (enabled).
  • -u <0|1> β€” turn showing usernames in front of the item on or off, for hosts that support it (Twitter.com/Instagram.com). default is 1 (enabled).
  • -v <0|1> β€” turn showing verbose output on or off, like, for instance, non-fatal errors and warnings from the XML parser. default is 1 (enabled).
  • -h, --help β€” show the help message

🌈 EXAMPLE OF USE 🌈

getting the RSS feed of some Twitter user:

tweeper https://twitter.com/NSACareers

using tweeper as a filter for the Liferea feed reader:

liferea-add-feed  "|tweeper https://twitter.com/NSAcareers"

to use tweeper via web there are two options (and btw these examples assume the installation directory is /usr/share/php/tweeper/):

  1. using the PHP built-in web server:
php -S localhost:8000 -t /usr/share/php/tweeper/

and then visit http://localhost:8000/tweeper.php in the web browser 🌐

  1. using a generic web server with the document root in /var/www:
sudo ln -s /usr/share/php/tweeper/tweeper.php /var/www
xdg-open http://localhost/tweeper.php?src_url=http://twitter.com/NSAcareers

and heads up: it's enough to create the symlink only the very first time tweeper is used this way. one and done, periodt ✨


πŸ™ˆ NOTES πŸ™ˆ

in order to use tweeper with a symlink with the apache userdir module, the SymLinksIfOwnerMatch option must be replaced by FollowSymlink in /etc/apache2/mods-enabled/userdir.conf

fr fr, don't skip this one, the symlink will simply not cooperate otherwise πŸ’€

⭐ EXIT STATUS ⭐

  • 0 β€” Success πŸŽ‰
  • !0 β€” Failure 😭

πŸ‘‘ AUTHORS πŸ‘‘

Antonio Ospite


πŸŽ€ RESOURCES πŸŽ€

Main web site: https://git.ao2.it/tweeper.git


πŸ’œ COPYING πŸ’œ

Copyright (C) 2013-2020 Antonio Ospite <ao2@ao2.it>

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.


and that's the whole page bestie, every last crumb 🫢 this version of the manual is dated 12/27/2020 and it lives under TWEEPER(1) β€” go forth and scrape responsibly, you absolute main character πŸ’–βœ¨

πŸ“¦ where this page comes from