RobotScraper is a simple tool written in Python to check each of the paths found in the robots.txt file and what HTTP response code they return.
☆15Jul 23, 2024Updated last year
Alternatives and similar repositories for robotScraper
Users that are interested in robotScraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DorkScraper is a simple tool written in Python to extract all the urls that appear when using a Google Dork.☆64Jul 23, 2024Updated last year
- Damn Vulnerable PHP Application (DVPA) - It is Lab Written in The PHP lang, Which Contains PHP Type Juggling - RCE Challenges☆32May 18, 2022Updated 4 years ago
- Control a system remotely via telegram in Powershell☆15Mar 28, 2025Updated last year
- None of the exploit code or research is my own but all available in public domain☆26Jun 9, 2019Updated 7 years ago
- Simple vulnerability labs that created using PHP and MySQL.☆16Dec 30, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Discord bot using the cryptography toolkit of SkeletonKey☆12Nov 18, 2024Updated last year
- ☆12Jun 2, 2021Updated 5 years ago
- 📚 本仓库是冰河重现Log4j远程过程执行漏洞的代码示例，完整重现了Log4j最新远程过程执行漏洞，如果对你有所帮助，请给个大大的Star，谢谢啦！！☆11May 29, 2022Updated 4 years ago
- Abusing autoElevate - Fully Undetectable UAC Bypass exploit☆11Jul 15, 2022Updated 3 years ago
- SMPP client library☆16Mar 17, 2026Updated 3 months ago
- Python Script for Hash Cracking☆11Sep 17, 2022Updated 3 years ago
- Setup an evil Access Point with powerful MITMf.☆16Nov 26, 2016Updated 9 years ago
- Covers the Arsenal for the BlackHat☆14Jan 16, 2026Updated 5 months ago
- URL Fuzzer☆22Nov 22, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Burp Extender to add unique form tokens to scanner requests.☆14Nov 5, 2024Updated last year
- Impacket is a collection of Python classes for working with network protocols.☆12Nov 11, 2023Updated 2 years ago
- A tool for extracting and filtering URLs, IPs, domains, and subdomains from text or web pages, with built-in web scraping capabilities.☆22Jun 22, 2026Updated last week
- WhatsApp forensics analysis and acquisition utility☆26Apr 2, 2013Updated 13 years ago
- Attempts to suspend all known AV/EDRs processes on Windows using syscalls and the undocumented NtSuspendProcess API. Made with <3 for pen…☆12May 11, 2023Updated 3 years ago
- Terminal Portfolio built with Vue 3 + Tailwind☆12Aug 24, 2024Updated last year
- Poc script for ProxyShell exploit chain in Exchange Server☆24Feb 24, 2022Updated 4 years ago
- Speed control has been a challenging conundrum for government on a global scale so the idea was to develop a vehicle speed detection sys…☆14Aug 26, 2022Updated 3 years ago
- FSL Test bench - Ansible playbook repository to setup a save environment for security auditing and testing. It can be used for teaching s…☆30Nov 26, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Dump Lsass Memory Using a Reflective Dll☆14Feb 4, 2022Updated 4 years ago
- Instagram crawler that utilizes a private API of Instagram. No developer account required.☆16Jun 3, 2018Updated 8 years ago
- AN ADVANCED PHISHING TOOL WITH MULTIPLE FUNCTIONALITY☆17Sep 23, 2018Updated 7 years ago
- BloodHound Automation: Collection, Analysis and Data Import☆21May 11, 2026Updated last month
- Cracking protocols FTP and SSH.☆10Aug 8, 2024Updated last year
- Generate malicious files using recently published homoglyphic-attack (CVE-2021-42694)☆18May 2, 2026Updated 2 months ago
- Image recon is a tool used to find the social media accounts associated with the uploading image.☆20Dec 18, 2020Updated 5 years ago
- Locomotive scroll combined with some ScrollTriger GSAP animations!☆13Nov 28, 2022Updated 3 years ago
- A Python Implementation of XQ Message SDK (V.2) which provides convenient access to the XQ Message API.☆11Apr 24, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Telegrip is a digital forensic tool that provides acquistion and analysis for Telegram-related cases.☆19May 11, 2022Updated 4 years ago
- A Selenium scraper for public domain search tools.☆18Oct 27, 2024Updated last year
- Monorepo of Labs for the Security Knowledge Framework (SKF)☆44Jun 12, 2025Updated last year
- Username recon OSINT. Accurate hits! New sites to check, Simple and powerful tool. Goverments use this tool or similar tools built in dif…☆19Jun 22, 2026Updated last week
- Twitter data around the Ukraine Invasion in February 2022☆15Jun 26, 2023Updated 3 years ago
- Web scraping is simply the process of using a social media web scraper to gather data automatically. It saves users time, effort and some…☆18Nov 6, 2021Updated 4 years ago
- A repository with my notable code snippets for Offensive Security's PEN-300 (OSEP) course.☆11Aug 2, 2021Updated 4 years ago