Spix0r / robofinder

Robofinder retrieves historical #robots.txt files from #Archive.org, allowing you to uncover previously disallowed directories and paths for any domain—essential for deepening your #OSINT and #recon process.
89Updated 3 weeks ago

Alternatives and similar repositories for robofinder:

Users that are interested in robofinder are comparing it to the libraries listed below