thecrowler

https://paolozaino.wordpress.com/portfolio/the-crowler/

Open Source

Categories

Reconnaissance

Description

A Content Discovery and Development Platform. Empowering Cybersecurity, AI, Marketing, and Finance professionals and researchers to discover, analyze, and interact with the web in all its dimensions.

Keywords

automation blue-team-tool content-detection content-discovery crawler crawling cyber-security cybersecurity data-collection data-science distributed-systems golang hacktoberfest indexer indexing reconnaissance red-team-tools scraping search-engine vulnerability-detection

Screenshots

Example Usage

./autobuild.sh

For authorized security testing and educational use only.