cytopia / crawlpyLinks
Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
☆54Updated 7 years ago
Alternatives and similar repositories for crawlpy
Users that are interested in crawlpy are comparing it to the libraries listed below
Sorting:
- Twintelligence is a free Twitter OSINT tool☆51Updated 5 years ago
- scrapin' proxies with ocr☆19Updated 7 years ago
- Insiderer looks inside files for metadata and hidden content☆37Updated 10 years ago
- An example chrome extension to demonstrate the dangers of injecting javascript and html into a page☆35Updated 8 years ago
- (Unofficial) Python API for http://netcraft.com☆15Updated 9 years ago
- General scripts for random stuff☆38Updated 4 years ago
- Scrapes the web for reliable http or https proxies and prints them to stdout. Can also be used as a python library to easily generate rel…☆34Updated 6 years ago
- A free and open source command-line shell and scripting language designed especially for security testing☆128Updated 12 years ago
- A web spider for shodan.io without using the Developer API.☆32Updated 7 years ago
- Create Tor hidden services in Python.☆52Updated 2 years ago
- Searches for interesting cached DNS entries.☆55Updated 11 years ago
- Download files out of open AWS buckets☆38Updated 7 years ago
- Simple web frontend to an elasticsearch database made for local files indexing☆19Updated 6 years ago
- DomainClassifier is a Python (2/3) library to extract and classify Internet domains/hostnames/IP addresses from raw unstructured text fil…☆80Updated last year
- Keep an eye on specific keywords being posted on Twitter☆46Updated 10 years ago
- Inforfinder is a tool to collect information of any domains pointing at some server (ip, domain, range, file). Is able to detect all doma…☆68Updated last year
- Download exploits from exploit-db.com☆46Updated 10 years ago
- A List of InfoSec Resources☆10Updated 11 years ago
- Vulnerable Web applications Generator☆84Updated 8 years ago
- Pown Proxy is a versatile web application security testing proxy with cool TUI features.☆60Updated 6 years ago
- Active/passive network scanner and autonomous vulnerability assessment application.☆76Updated 5 years ago
- Some useful scripts for penetration testing☆46Updated 8 years ago
- HMAC timing attack's w/ statistical analysis☆23Updated 12 years ago
- Maltego Transforms to Query Traffic Records☆34Updated 10 years ago
- Easy to use command line security scanner☆58Updated 9 years ago
- Anti-Anti-Automation Framework☆100Updated 11 years ago
- Truehunter☆30Updated 4 years ago
- A collection of notes and script that will help you learn basics of hacking with Python☆34Updated 11 years ago
- Minimalistic DNS logging tool☆43Updated 3 years ago
- Server Shield is a lightweight method of protecting and hardening your Linux server. It is easy to install, hard to mess up, and makes yo…☆173Updated 12 years ago