crawlic

Web recon tool (find temporary files, parse robots.txt, search folders, google dorks and search domains hosted on same s

webappRed Team

Official docs ↗Download ↗

Platforms: Linux · Last verified September 6, 2026

Web recon tool (find temporary files, parse robots.txt, search folders, google dorks and search domains hosted on same server).

Only use this tool against systems you own or are explicitly authorized to test — see the disclaimer.

Getting started

Install on BlackArch with `pacman -S crawlic` (or add the BlackArch repository to an existing Arch Linux install). See the official BlackArch tool listing and upstream homepage linked above for details.

Commonly preinstalled on

BlackArch

Arch Linux-based distribution with one of the largest pentest tool repositories