RobotScraper is a simple tool written in Python to check each of the paths found in the robots.txt file and what HTTP response code they return.
☆15Jul 23, 2024Updated 2 years ago
Alternatives and similar repositories for robotScraper
Users that are interested in robotScraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Control a system remotely via telegram in Powershell☆16Mar 28, 2025Updated last year
- Abusing autoElevate - Fully Undetectable UAC Bypass exploit☆11Jul 15, 2022Updated 4 years ago
- Python Script for Hash Cracking☆11Sep 17, 2022Updated 4 years ago
- A command-line utility for working with URLs.☆10Dec 8, 2025Updated 11 months ago
- Cracking protocols FTP and SSH.☆10Aug 8, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- WatchTower - A platform to save your valuable time while staying updated in the Cyber realm.☆18Jun 13, 2026Updated 5 months ago
- 📚 本仓库是冰河重现Log4j远程过程执行漏洞的代码示例,完整重现了Log4j最新远程过程执行漏洞,如果对你有所帮助,请给个大大的Star,谢谢啦!!☆11May 29, 2022Updated 4 years ago
- crEAP - Python script to identify wireless networks EAP types and harvest users☆14Oct 17, 2023Updated 3 years ago
- A Python Implementation of XQ Message SDK (V.2) which provides convenient access to the XQ Message API.☆11Apr 24, 2026Updated 6 months ago
- Burp Extender to add unique form tokens to scanner requests.☆14Nov 5, 2024Updated 2 years ago
- Instagram account information☆14Sep 18, 2022Updated 4 years ago
- Flipper Zero Bad USB payloads☆45Mar 31, 2025Updated last year
- SMPP client library☆16Mar 17, 2026Updated 8 months ago
- Python program to check vehicle info in sri lanka☆13May 14, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Symfony API Platform with ReactJS admin client example configuration for Platform.sh. Maintained by the Platform.sh team. http://platform…☆11Jan 31, 2018Updated 8 years ago
- MagicRecon is a powerful shell script to maximize the recon and data collection process of an objective and finding common vulnerabilitie…☆1,056Jul 23, 2024Updated 2 years ago
- Instagram crawler that utilizes a private API of Instagram. No developer account required.☆15Jun 3, 2018Updated 8 years ago
- Universal Plug and Play (UPnP) Fuzzer☆16Jan 25, 2025Updated last year
- ☆14Aug 9, 2026Updated 3 months ago
- Image recon is a tool used to find the social media accounts associated with the uploading image.☆21Dec 18, 2020Updated 5 years ago
- Bl0ck: a tool to interrupt the transmission of QoS Data frames in Wi-Fi 5 and 6 networks☆13Sep 15, 2025Updated last year
- Dump Lsass Memory Using a Reflective Dll☆14Feb 4, 2022Updated 4 years ago
- ☆15Nov 15, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- It is a simple javascript app for painting☆15Jun 24, 2020Updated 6 years ago
- Impacket is a collection of Python classes for working with network protocols.☆13Nov 11, 2023Updated 3 years ago
- Updog3 is a fork of Sc0tfree's Updog tool, which was a replacement for Python's SimpleHTTPServer. It allows uploading and downloading via…☆12Mar 8, 2025Updated last year
- ZXCVBN Password Strength Estimation with Czech or Slovak Dictionaries☆16Jun 14, 2017Updated 9 years ago
- A ZAPROXY Add-on that allows testing of web application vulnerabilities by recording complex multi-step sequences. You can test applica…☆23May 14, 2025Updated last year
- Attempts to suspend all known AV/EDRs processes on Windows using syscalls and the undocumented NtSuspendProcess API. Made with <3 for pen…☆12May 11, 2023Updated 3 years ago
- Generate malicious files using recently published homoglyphic-attack (CVE-2021-42694)☆18May 2, 2026Updated 6 months ago
- A Selenium scraper for public domain search tools.☆18Oct 27, 2024Updated 2 years ago
- Load the evilDLL from socket connection without touch disk☆15Aug 27, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Web scraping is simply the process of using a social media web scraper to gather data automatically. It saves users time, effort and some…☆19Nov 6, 2021Updated 5 years ago
- ASNPepper - Recon in ASN - Extracting CIDR's - Fast and efficient scanning☆19Oct 27, 2024Updated 2 years ago
- Next.js PoC for CVE-2025-29927☆15Mar 24, 2025Updated last year
- a better way to catch them all!☆13Feb 10, 2026Updated 9 months ago
- Terminal Portfolio built with Vue 3 + Tailwind☆13Aug 24, 2024Updated 2 years ago
- Simple recon tool automates your recon process☆16Apr 15, 2023Updated 3 years ago
- Script para la instalación automática de una capa de personalización en Kali Linux OS.☆17Sep 10, 2026Updated 2 months ago
Are these results useful?