cytopia / crawlpy
Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
☆55Updated 6 years ago
Alternatives and similar repositories for crawlpy:
Users that are interested in crawlpy are comparing it to the libraries listed below
- Download files out of open AWS buckets☆38Updated 6 years ago
- Automated Reverse TCP tunneling using a digitalocean instance and aploium's shootback repo (https://github.com/aploium/shootback)☆13Updated 6 years ago
- Learning Python☆9Updated 3 months ago
- scrapin' proxies with ocr☆19Updated 6 years ago
- Simple Bash script to retrieve basic system information.☆30Updated 7 years ago
- (Unofficial) Python API for http://namechk.com☆19Updated 9 years ago
- A free and open source command-line shell and scripting language designed especially for security testing☆127Updated 11 years ago
- Explains and tests HTTP response headers☆41Updated 5 years ago
- A tool for collecting compromised email address☆9Updated 9 years ago
- a mass web screenshot tool for mapping web networks.☆24Updated 10 years ago
- Pown Proxy is a versatile web application security testing proxy with cool TUI features.☆60Updated 5 years ago
- Set of Python scripts to perform SecRules language evaluation on a given http request.☆14Updated 7 years ago
- A set of Python scripts for generating, parsing, sorting, and saving wordlists.☆50Updated 3 years ago
- (Unofficial) Python API for http://netcraft.com☆15Updated 8 years ago
- Data exfiltration using covert channels in the TCP/IP protocol with some basic steganography.☆13Updated 8 years ago
- Tool to obtain information about IP or domain: Geolocation, network, whois and opened ports.☆17Updated 7 years ago
- Script to spider a website and find publicly open S3 buckets☆26Updated 4 years ago
- Go command line app to exploit file upload vulnerability☆12Updated 8 years ago
- A collection of nmap scripts I've written☆23Updated 9 years ago
- Python script to scan for weak CBC ciphers, weak MAC algorithms and support auth methods.☆17Updated 9 years ago
- A Burp Suite extension that checks if a particular URL responds differently to various User-Agent headers☆15Updated 10 years ago
- python based backdoor software☆17Updated 13 years ago
- A tool for enumerating expired domains in CNAME records☆59Updated 8 years ago
- A web spider for shodan.io without using the Developer API.☆31Updated 7 years ago
- Reflective/DOM XSS scanner built on casperJS☆81Updated 10 years ago
- Scans crossdomain.xml policies for expired domain names.☆25Updated 9 years ago
- Do some quick reconnaissance on a domain-based web-application☆13Updated 3 years ago
- A recon-ng module for crawling Indeed.com for contacts and resumes.☆12Updated 9 years ago
- Monitor arbitrary TCP traffic using your HTTP interception proxy of choice☆48Updated 7 years ago
- all things awesome security☆12Updated 9 years ago