subby.py

subdomain enumeration with simple data aggregators built in

Installation

In order to rub Subby, you need the following Python and Golang packages:

  requests (python)
  beautifulsoup4 (python)
  httpx (go)

To install these packages, do the following:

Python

pip install -r requirements.txt

Go

go install -v github.com/projectdiscovery/httpx/cmd/httpx@latest
go install -v github.com/projectdiscovery/subfinder/v2/cmd/subfinder@latest

Running the script

After installing all of the required packages and binaries, you can either scan a singular domain or run multiple from a text file.

python3 subpy.py -d example.com

or

python3 subpy.py -f file.txt

Visual Demo

multiple domains

Credits

• credits go respectfully and with love to Project Discovery go binary
• credits also go to myssl.com, rapiddns.io, hackertarget.com, jldc.me, and alienvault.com for providing the APIs needed for the data aggregation.

TODO

• improve regex rules
• add sitedossier, crt.sh, archive.org as aggregators
• multiprocessing for multiple domains (chunk each domain scan into a seperate process to run concurrent with the rest)