URLEXTRACTOR(1)

📦 version 0.2.0, in debian bookworm, debian trixie, ubuntu jammy, ubuntu noble, ubuntu resolute, ubuntu stonking

💖 URLEXTRACTOR 💖

okay bestie, so this is urlextractor, section 1 of the manual (the "Usage" one, iykyk). it's a whole vibe. let's get into it 🫶

✨ NAME ✨

URLEXTRACTOR — information gathering and website reconnaissance 🕵️‍♀️💅

✨ SYNOPSIS ✨

urlextractor [URL]

✨ DESCRIPTION ✨

so like, urlextractor goes and gathers information from the URL you give it and prints it all out to STDOUT. main character energy fr fr. and the tea it collects is:

  • IP and hosting info like city and country (using FreegeoIP) 🌍
  • DNS servers (using dig) 🔍
  • ASN, Network range, ISP name (using RISwhois) 📡
  • Load balancer test ⚖️
  • Whois for abuse mail (using Spamcop) 📧
  • PAC (Proxy Auto Configuration) file 📄
  • Compares hashes to diff code 🔐
  • robots.txt (recursively looking for hidden stuff) 🤫
  • Source code (looking for passwords and users) 👀
  • External links (frames from other websites) 🔗
  • Directory FUZZ (like Dirbuster and Wfuzz - using Dirbuster) directory list) 💥
  • URLvoid API - checks Google page rank, Alexa rank and possible blacklists 🚫
  • Provides useful links at other websites to correlate with IP/ASN 🌐
  • Option to open ALL results in browser at the end 🖥️✨

✨ FILES ✨

when urlextractor runs, it checks whether the directory $HOME/.urlextractor exists, and if it does not exist, the directory gets created. no cap, this previous behaviour was added in Debian Systems so everyone could have a better user experience 🎀

  • $HOME/.urlextractor/config — the configuration file used to customize default program settings. once the directory $HOME/.urlextractor is created, a default configuration file is copied from the package examples directory /usr/share/doc/urlextractor/examples/config, and it contains a default configuration to enable urlextractor to work. for more info about the configuration, check the example file. 💜
  • $HOME/.urlextractor/log.csv — saves the scanned sites for future reference. 📝

✨ AUTHOR ✨

Eduardo Schultze <eduardo.schultze@gmail.com> (2016). 👑

✨ NOTES ✨

this manual page has been written by Josue Ortega <josue@debian.org> for the Debian project (and may be used by others). 🌸

✨ LICENSE ✨

The MIT License (MIT) 📜

and that's the whole thing bestie!! version 0.2.0, dated FEBRUARY 27, 2021 — iconic, we stan, periodt 💅✨🎀

📦 where this page comes from