RobotScraper is a simple tool written in Python to check each of the paths found in the robots.txt file and what HTTP response code they return.
☆14Jul 23, 2024Updated last year
Alternatives and similar repositories for robotScraper
Users that are interested in robotScraper are comparing it to the libraries listed below
Sorting:
- DorkScraper is a simple tool written in Python to extract all the urls that appear when using a Google Dork.☆59Jul 23, 2024Updated last year
- Simple vulnerability labs that created using PHP and MySQL.☆16Dec 30, 2022Updated 3 years ago
- Abusing autoElevate - Fully Undetectable UAC Bypass exploit