Spix0r / robofinder

Robofinder retrieves historical #robots.txt files from #Archive.org, allowing you to uncover previously disallowed directories and paths for any domain—essential for deepening your #OSINT and #recon process.
44Updated last week

Related projects

Alternatives and complementary repositories for robofinder