RobotScraper is a simple tool written in Python to check each of the paths found in the robots.txt file and what HTTP response code they return.
☆15Jul 23, 2024Updated last year
Alternatives and similar repositories for robotScraper
Users that are interested in robotScraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DorkScraper is a simple tool written in Python to extract all the urls that appear when using a Google Dork.☆63Jul 23, 2024Updated last year
- Control a system remotely via telegram in Powershell☆15Mar 28, 2025Updated last year
- Discord bot using the cryptography toolkit of SkeletonKey☆12Nov 18, 2024Updated last year
- 📚 本仓库是冰河重现Log4j远程过程执行漏洞的代码示例，完整重现了Log4j最新远程过程执行漏洞，如果对你有所帮助，请给个大大的Star，谢谢啦！！☆11May 29, 2022Updated 4 years ago
- SMPP client library☆16Mar 17, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Python Script for Hash Cracking☆11Sep 17, 2022Updated 3 years ago
- Covers the Arsenal for the BlackHat☆14Jan 16, 2026Updated 4 months ago
- URL Fuzzer☆22Nov 22, 2024Updated last year
- Burp Extender to add unique form tokens to scanner requests.☆14Nov 5, 2024Updated last year
- Impacket is a collection of Python classes for working with network protocols.☆12Nov 11, 2023Updated 2 years ago
- A tool for extracting and filtering URLs, IPs, domains, and subdomains from text or web pages, with built-in web scraping capabilities.☆22May 18, 2026Updated 3 weeks ago
- Attempts to suspend all known AV/EDRs processes on Windows using syscalls and the undocumented NtSuspendProcess API. Made with <3 for pen…☆13May 11, 2023Updated 3 years ago
- FSL Test bench - Ansible playbook repository to setup a save environment for security auditing and testing. It can be used for teaching s…☆30Nov 26, 2024Updated last year
- Dump Lsass Memory Using a Reflective Dll☆14Feb 4, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Instagram crawler that utilizes a private API of Instagram. No developer account required.☆15Jun 3, 2018Updated 8 years ago
- AN ADVANCED PHISHING TOOL WITH MULTIPLE FUNCTIONALITY☆17Sep 23, 2018Updated 7 years ago
- Cracking protocols FTP and SSH.☆10Aug 8, 2024Updated last year
- Generate malicious files using recently published homoglyphic-attack (CVE-2021-42694)☆18May 2, 2026Updated last month
- A Selenium scraper for public domain search tools.☆18Oct 27, 2024Updated last year
- Username recon OSINT. Accurate hits! New sites to check, Simple and powerful tool. Goverments use this tool or similar tools built in dif…☆20Feb 19, 2026Updated 3 months ago
- A repository with my notable code snippets for Offensive Security's PEN-300 (OSEP) course.☆11Aug 2, 2021Updated 4 years ago
- Instagram account information☆14Sep 18, 2022Updated 3 years ago
- Wordpress Hunting Vulnerabilities and Bruteforce tool using Google Dork☆14Sep 16, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MagicRecon is a powerful shell script to maximize the recon and data collection process of an objective and finding common vulnerabilitie…☆1,037Jul 23, 2024Updated last year
- A ZAPROXY Add-on that allows testing of web application vulnerabilities by recording complex multi-step sequences. You can test applica…☆22May 14, 2025Updated last year
- Simple recon tool automates your recon process☆16Apr 15, 2023Updated 3 years ago
- Core C++ library for C2 architecture, message handling, and security tooling experiments.☆24May 13, 2026Updated last month
- A webshell plugin and interactive shell for pentesting a LimeSurvey application.☆23Oct 31, 2024Updated last year
- A Ruby DSL for crafting SQL Injections☆46Jan 12, 2026Updated 5 months ago
- A tool to abuse weak permissions of Active Directory Discretionary Access Control Lists (DACLs) and Access Control Entries (ACEs)☆62Feb 4, 2026Updated 4 months ago
- s3eker is an extensible way to find open S3 buckets.☆17Jul 31, 2020Updated 5 years ago
- Python program to check vehicle info in sri lanka☆12May 14, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Malcolm is a powerful, easily deployable network traffic analysis tool suite for full packet capture artifacts (PCAP files), Zeek logs an…☆33Jun 5, 2026Updated last week
- EmailSecCheck is a lightweight Python utility used to check for common SPF/DMARC misconfigurations that may allow for email spoofing.☆21May 9, 2025Updated last year
- Proof-of-Concept for Authorization Bypass in Next.js Middleware☆19Mar 23, 2025Updated last year
- Remote Email Keylogger☆14Jun 2, 2022Updated 4 years ago
- Load the evilDLL from socket connection without touch disk☆15Aug 27, 2021Updated 4 years ago
- The Covert Channel Educational Analysis Protocol (CCEAP) is a network protocol designed for teaching covert channels to professionals and…☆15Apr 17, 2025Updated last year
- A stealthy reverse shell built with native PowerShell and Server-Sent Events (SSE). No polling. No sockets. Just pure HTTP and real-time …☆22Apr 23, 2025Updated last year