Spix0r / robofinder

Robofinder retrieves historical #robots.txt files from #Archive.org, allowing you to uncover previously disallowed directories and paths for any domain—essential for deepening your #OSINT and #recon process.
45Updated 2 weeks ago

Related projects

Alternatives and complementary repositories for robofinder