← All tools

xcrawl3r

https://github.com/hueristiq/xcrawl3r

Open Source

Categories

Reconnaissance Web Application

Description

A command-line utility designed to recursively spider webpages for URLs. It works by actively traversing websites - following links embedded in webpages, parsing resources like sitemaps and robots.txt files, and even processing local files - to uncover every URL.

Keywords

bug-bounty bug-bounty-tools contentdiscovery crawler ethical-hacking ethical-hacking-tools go golang penetration-testing penetration-testing-tools reconnaissance red-teaming red-teaming-tools web-security

Example Usage

xcrawl3r -h

See also

xalgorix

Open Source

Xalgorix - The Most Powerful Open-Source AI Pentesting Agent…

EyeWitness

Open Source Kali

Takes screenshots of web pages, RDP, and VNC services. Reports on default credentials and interestin…

Flipper Zero

Open Source

Portable multi-tool for hardware hacking. Supports Sub-GHz radio, 125kHz RFID, NFC, Infrared, iButto…

GraphQL Voyager / InQL

Open Source

InQL is a Burp Suite and standalone GraphQL security scanner. Analyzes introspection queries, genera…

horus

Open Source

An OSINT / digital forensics tool built in Python…

JWT_Tool

Open Source

Toolkit for testing, tampering, and forging JSON Web Tokens. Tests common JWT vulnerabilities includ…