cytopia / crawlpy
Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
☆55Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for crawlpy
- Download files out of open AWS buckets☆37Updated 5 years ago
- scrapin' proxies with ocr☆19Updated 6 years ago
- async web crawler☆26Updated 10 years ago
- A free and open source command-line shell and scripting language designed especially for security testing☆127Updated 11 years ago
- Automated Reverse TCP tunneling using a digitalocean instance and aploium's shootback repo (https://github.com/aploium/shootback)☆13Updated 6 years ago
- Pown Proxy is a versatile web application security testing proxy with cool TUI features.☆61Updated 5 years ago
- Automated Security Assessment Reporting Tool☆39Updated 6 years ago
- Mass HTTP brute forcer to detect directories and interesting technologies☆10Updated 7 years ago
- Search for potential passwords/data leaks in a folder or git repo☆23Updated 6 years ago
- Anontwi is a tool for OAuth2 applications (such as: GNUSocial, Twitter) that provides different layers of encryption, privacy methods and…☆31Updated 9 years ago
- Crawl Google and Bing to find emails, subdomains and URLs associated to a target domain☆48Updated 3 years ago
- An enchanting 🔮 web screenshot tool for capturing and sharing web content effortlessly☆34Updated 4 months ago
- Script to automate the installation and buildouts of OpenVPN servers and clients.☆12Updated 9 years ago
- Explains and tests HTTP response headers☆40Updated 5 years ago
- Learning Python☆9Updated 3 weeks ago
- Pull A List Of 1000 Most Popular Containers On Docker Hub☆14Updated 4 years ago
- Monitor Certificate Transparency Logs For Phishing Domains☆25Updated 6 years ago
- A tool for collecting compromised email address☆9Updated 9 years ago
- Go command line app to exploit file upload vulnerability☆12Updated 7 years ago
- Script for applied security baseline controls in RedHat/CentOS.☆12Updated 8 years ago
- Server Shield is a lightweight method of protecting and hardening your Linux server. It is easy to install, hard to mess up, and makes yo…☆173Updated 11 years ago
- A recon-ng module for crawling Indeed.com for contacts and resumes.☆12Updated 8 years ago
- ☆13Updated 2 years ago
- Do some quick reconnaissance on a domain-based web-application☆13Updated 3 years ago
- Show Exploit-Database With Static HTML Automatic Generate Everyday.☆13Updated 3 years ago
- Build a search engine from nmap XML files☆20Updated 10 years ago