MartiONE / scrapy-proxy-spiders
Scrapy proxy crawler with python 3
☆19Updated 4 years ago
Alternatives and similar repositories for scrapy-proxy-spiders:
Users that are interested in scrapy-proxy-spiders are comparing it to the libraries listed below
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated 7 months ago
- In browser VNC client through websockets☆30Updated 13 years ago
- Keeps your secret things☆83Updated 6 years ago
- A tool that starts a DigitalOcean droplet in a given region and runs a given command, displaying the output.☆25Updated 8 years ago
- A random user agent API service.☆34Updated 2 years ago
- A parser for the free proxy list on HideMyAss!☆57Updated 7 years ago
- [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings☆48Updated 4 years ago
- A generic crawler☆78Updated 6 years ago
- "Scrape Easy" - an extension of the Scrapy framework.☆189Updated 8 years ago
- Scrapes the obfuscated proxy list at proxylist.hidemyass.com☆32Updated 5 years ago
- ctypes bindings for libphash to robustly compare media files☆12Updated 2 years ago
- A weather monitoring Dashboard built upon Python and Yahoo API☆14Updated 9 years ago
- Crochet-based blocking API for Scrapy.☆46Updated 7 years ago
- [Python] Google Scraper & Mass Exploiter☆29Updated 3 years ago
- A library to interface with the Linkscape API.☆40Updated 6 years ago
- A persistent, full-text searchable key-value store. Powered by Flask, ElasticSearch, S3, and good intentions.☆479Updated 7 years ago
- A HTTP reverse proxy with TLS+SNI support.☆39Updated 5 years ago
- Pyzmail is a high level mail library for Python, providing functions to read, compose and send emails☆59Updated 6 years ago
- Bringing sanity to world of messed-up data☆65Updated 10 years ago
- Scrapy middleware which allows to crawl only new content☆79Updated 2 years ago
- Replaces all .jpg and .png with a picture of nicolas cage.☆10Updated 10 years ago
- Parse domains using the TLD list maintained by publicsuffix.org☆61Updated 4 years ago
- PyQuery-based scraping micro-framework.☆115Updated 3 years ago
- Smartyparse: A python library for smart dynamic binary de/encoding.☆15Updated 6 years ago
- URL Transformation, Sanitization☆103Updated last year
- [UNMAINTAINED] Firefox addon for Scrapely☆5Updated 9 years ago
- Tools that will make writing tests, bots and scrapers using Selenium much easier☆141Updated last month
- A Django based search engine powered by CouchDB, celery and whoosh.☆49Updated 9 years ago