RobotScraper is a simple tool written in Python to check each of the paths found in the robots.txt file and what HTTP response code they return.
☆14Jul 23, 2024Updated last year
Alternatives and similar repositories for robotScraper
Users that are interested in robotScraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Damn Vulnerable PHP Application (DVPA) - It is Lab Written in The PHP lang, Which Contains PHP Type Juggling - RCE Challenges☆32May 18, 2022Updated 3 years ago
- Control a system remotely via telegram in Powershell☆14Mar 28, 2025Updated last year
- ☆12Jun 2, 2021Updated 4 years ago
- Abusing autoElevate - Fully Undetectable UAC Bypass exploit☆11Jul 15, 2022Updated 3 years ago
- Setup an evil Access Point with powerful MITMf.☆17Nov 26, 2016Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Covers the Arsenal for the BlackHat☆14Jan 16, 2026Updated 2 months ago
- URL Fuzzer☆20Nov 22, 2024Updated last year
- Burp Extender to add unique form tokens to scanner requests.☆13Nov 5, 2024Updated last year
- A tool for extracting and filtering URLs, IPs, domains, and subdomains from text or web pages, with built-in web scraping capabilities.☆16Mar 10, 2025Updated last year
- FSL Test bench - Ansible playbook repository to setup a save environment for security auditing and testing. It can be used for teaching s…☆30Nov 26, 2024Updated last year
- Instagram crawler that utilizes a private API of Instagram. No developer account required.☆15Jun 3, 2018Updated 7 years ago
- AN ADVANCED PHISHING TOOL WITH MULTIPLE FUNCTIONALITY☆17Sep 23, 2018Updated 7 years ago
- BloodHound Automation: Collection, Analysis and Data Import☆20Nov 12, 2025Updated 5 months ago
- Image recon is a tool used to find the social media accounts associated with the uploading image.☆20Dec 18, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Generate malicious files using recently published homoglyphic-attack (CVE-2021-42694)☆18May 23, 2023Updated 2 years ago
- A Python Implementation of XQ Message SDK (V.2) which provides convenient access to the XQ Message API.☆11Updated this week
- A command-line utility for working with URLs.☆10Dec 8, 2025Updated 4 months ago
- Username recon OSINT. Accurate hits! New sites to check, Simple and powerful tool. Goverments use this tool or similar tools built in dif…☆18Feb 19, 2026Updated last month
- Web scraping is simply the process of using a social media web scraper to gather data automatically. It saves users time, effort and some…☆17Nov 6, 2021Updated 4 years ago
- This project focuses on detecting cyberattacks using advanced analytical techniques and a deep learning model. It leverages structured da…☆10Feb 21, 2025Updated last year
- Instagram account information☆14Sep 18, 2022Updated 3 years ago
- SigFramework it's a modified version of SiGploit☆22Jan 19, 2026Updated 2 months ago
- MagicRecon is a powerful shell script to maximize the recon and data collection process of an objective and finding common vulnerabilitie…☆1,035Jul 23, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Command and Control Framework using powershell implants☆36Jun 17, 2025Updated 9 months ago
- Simple recon tool automates your recon process☆16Apr 15, 2023Updated 2 years ago
- Core Submodule of Exploration C2☆24Jan 27, 2026Updated 2 months ago
- Novel Windows process injection: assembles existing open handles (process & thread), natural RWX regions, and special user APC (NtQueueAp…☆69Feb 17, 2026Updated last month
- A set of scripts to facilitate HTTP interception on mobile apps☆22Mar 11, 2026Updated last month
- A webshell plugin and interactive shell for pentesting a LimeSurvey application.☆23Oct 31, 2024Updated last year
- A Ruby DSL for crafting SQL Injections☆46Jan 12, 2026Updated 3 months ago
- A webshell plugin and interactive shell for pentesting JoGet application.☆14May 19, 2022Updated 3 years ago
- s3eker is an extensible way to find open S3 buckets.☆17Jul 31, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Remote Email Keylogger☆14Jun 2, 2022Updated 3 years ago
- PAKURI-THON is a tool that supports pentesters with various pentesting tools and C4 server (command & control and chat & communication se…☆26Jul 18, 2022Updated 3 years ago
- Load the evilDLL from socket connection without touch disk☆15Aug 27, 2021Updated 4 years ago
- The Covert Channel Educational Analysis Protocol (CCEAP) is a network protocol designed for teaching covert channels to professionals and…☆15Apr 17, 2025Updated 11 months ago
- MAAPP is an Android/iOS App API penetration tool☆24Feb 23, 2023Updated 3 years ago
- WatchTower - A platform to save your valuable time while staying updated in the Cyber realm.☆18Dec 31, 2025Updated 3 months ago
- A python library to interact with Pwndoc instances for pentest reports generation☆24May 19, 2025Updated 10 months ago