RobotScraper is a simple tool written in Python to check each of the paths found in the robots.txt file and what HTTP response code they return.
☆14Jul 23, 2024Updated last year
Alternatives and similar repositories for robotScraper
Users that are interested in robotScraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Damn Vulnerable PHP Application (DVPA) - It is Lab Written in The PHP lang, Which Contains PHP Type Juggling - RCE Challenges☆32May 18, 2022Updated 3 years ago
- Control a system remotely via telegram in Powershell☆14Mar 28, 2025Updated last year
- Abusing autoElevate - Fully Undetectable UAC Bypass exploit☆11Jul 15, 2022Updated 3 years ago
- SMPP client library☆15Mar 17, 2026Updated last month
- Setup an evil Access Point with powerful MITMf.☆16Nov 26, 2016Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Covers the Arsenal for the BlackHat☆14Jan 16, 2026Updated 3 months ago
- Impacket is a collection of Python classes for working with network protocols.☆12Nov 11, 2023Updated 2 years ago
- Attempts to suspend all known AV/EDRs processes on Windows using syscalls and the undocumented NtSuspendProcess API. Made with <3 for pen…☆13May 11, 2023Updated 2 years ago
- Dump Lsass Memory Using a Reflective Dll☆14Feb 4, 2022Updated 4 years ago
- Instagram crawler that utilizes a private API of Instagram. No developer account required.☆15Jun 3, 2018Updated 7 years ago
- FSL Test bench - Ansible playbook repository to setup a save environment for security auditing and testing. It can be used for teaching s…☆30Nov 26, 2024Updated last year
- AN ADVANCED PHISHING TOOL WITH MULTIPLE FUNCTIONALITY☆17Sep 23, 2018Updated 7 years ago
- Image recon is a tool used to find the social media accounts associated with the uploading image.☆20Dec 18, 2020Updated 5 years ago
- A Python Implementation of XQ Message SDK (V.2) which provides convenient access to the XQ Message API.☆11Apr 24, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Telegrip is a digital forensic tool that provides acquistion and analysis for Telegram-related cases.☆19May 11, 2022Updated 3 years ago
- A Selenium scraper for public domain search tools.☆18Oct 27, 2024Updated last year
- A repository with my notable code snippets for Offensive Security's PEN-300 (OSEP) course.☆11Aug 2, 2021Updated 4 years ago
- Instagram account information☆14Sep 18, 2022Updated 3 years ago
- Wordpress Hunting Vulnerabilities and Bruteforce tool using Google Dork☆14Sep 16, 2021Updated 4 years ago
- Command and Control Framework using powershell implants☆36Jun 17, 2025Updated 10 months ago
- A ZAPROXY Add-on that allows testing of web application vulnerabilities by recording complex multi-step sequences. You can test applica…☆22May 14, 2025Updated 11 months ago
- Simple recon tool automates your recon process☆16Apr 15, 2023Updated 3 years ago
- Core Submodule of Exploration C2☆24Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Novel Windows process injection: assembles existing open handles (process & thread), natural RWX regions, and special user APC (NtQueueAp…☆70Feb 17, 2026Updated 2 months ago
- A webshell plugin and interactive shell for pentesting JoGet application.☆14May 19, 2022Updated 3 years ago
- s3eker is an extensible way to find open S3 buckets.☆17Jul 31, 2020Updated 5 years ago
- EmailSecCheck is a lightweight Python utility used to check for common SPF/DMARC misconfigurations that may allow for email spoofing.☆20May 9, 2025Updated 11 months ago
- Remote Email Keylogger☆14Jun 2, 2022Updated 3 years ago
- Load the evilDLL from socket connection without touch disk☆15Aug 27, 2021Updated 4 years ago
- The Covert Channel Educational Analysis Protocol (CCEAP) is a network protocol designed for teaching covert channels to professionals and…☆15Apr 17, 2025Updated last year
- A stealthy reverse shell built with native PowerShell and Server-Sent Events (SSE). No polling. No sockets. Just pure HTTP and real-time …☆22Apr 23, 2025Updated last year
- MAAPP is an Android/iOS App API penetration tool☆24Feb 23, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Android Pentest Setup Environment☆30May 9, 2022Updated 3 years ago
- A Python package and command line utility for scanning emails with YARA rules☆22Apr 5, 2026Updated last month
- ASNPepper - Recon in ASN - Extracting CIDR's - Fast and efficient scanning☆19Oct 27, 2024Updated last year
- A tech enumeration toolkit focused on 404 Not found pages.☆27Oct 6, 2024Updated last year
- Crack password ZIP, RAR and PDF with dictionary.☆26Oct 4, 2023Updated 2 years ago
- Learning Various Process Injection Techniques☆18Apr 4, 2019Updated 7 years ago
- A Python-native Detection as Code Framework☆19Jan 23, 2026Updated 3 months ago