← All tools

robofinder

https://github.com/Spix0r/robofinder

Open Source

Categories

Reconnaissance

Description

Robofinder retrieves historical #robots.txt files from #Archive.org, allowing you to collect old directories and paths for any domain which can helps you in your #OSINT and #recon process.

Keywords

bugbounty bugbounty-tool osint osint-python osint-resources osint-tool osint-tools recon reconnaissance python

Example Usage

robofinder -u https://example.com -t 10 -o results.txt -s -p