cytopia / crawlpyLinks
Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
☆54Updated 6 years ago
Alternatives and similar repositories for crawlpy
Users that are interested in crawlpy are comparing it to the libraries listed below
Sorting:
- An example chrome extension to demonstrate the dangers of injecting javascript and html into a page☆35Updated 8 years ago
- scrapin' proxies with ocr☆19Updated 7 years ago
- Download files out of open AWS buckets☆38Updated 6 years ago
- An enchanting 🔮 web screenshot tool for capturing and sharing web content effortlessly☆33Updated 3 months ago
- Insiderer looks inside files for metadata and hidden content☆37Updated 10 years ago
- Create Tor hidden services in Python.☆52Updated 2 years ago
- Python backdoor that uses http post/get requests to communicate☆41Updated 9 years ago
- (Unofficial) Python API for http://netcraft.com☆15Updated 9 years ago
- A free and open source command-line shell and scripting language designed especially for security testing☆128Updated 11 years ago
- Simple, hand-picked list of fuzz strings☆33Updated 8 years ago
- A set of Python scripts for generating, parsing, sorting, and saving wordlists.☆50Updated 3 years ago
- Chef repository for pentesting tools☆13Updated 8 years ago
- a command-line web scraping tool☆149Updated 2 years ago
- ☆39Updated 7 years ago
- Simple Bash script to retrieve basic system information.☆30Updated 7 years ago
- General scripts for random stuff☆38Updated 3 years ago
- Searches for interesting cached DNS entries.☆55Updated 11 years ago
- This tool seeks asynchronously TrueCrypt key file using combinations of provided key files with provided password.☆48Updated 7 years ago
- async web crawler☆25Updated 11 years ago
- Pown Proxy is a versatile web application security testing proxy with cool TUI features.☆60Updated 6 years ago
- Twintelligence is a free Twitter OSINT tool☆52Updated 4 years ago
- A collection of notes and script that will help you learn basics of hacking with Python☆34Updated 10 years ago
- Vulnerable Web applications Generator☆84Updated 7 years ago
- Maltego Transforms to Query Traffic Records☆34Updated 9 years ago
- Scrapes the web for reliable http or https proxies and prints them to stdout. Can also be used as a python library to easily generate rel…☆34Updated 5 years ago
- DomainClassifier is a Python (2/3) library to extract and classify Internet domains/hostnames/IP addresses from raw unstructured text fil…☆78Updated last year
- Simple web frontend to an elasticsearch database made for local files indexing☆19Updated 5 years ago
- Inforfinder is a tool to collect information of any domains pointing at some server (ip, domain, range, file). Is able to detect all doma…☆68Updated 11 months ago
- Streaming web crawler with WebSocket API☆44Updated 2 years ago
- Automate Recon process using Shell Scripting☆11Updated 3 years ago