MartiONE / scrapy-proxy-spiders

Related projects ⓘ

Alternatives and complementary repositories for scrapy-proxy-spiders

• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 6 months ago
• arkaitzj / wsvnc
  In browser VNC client through websockets
  ☆30Updated 13 years ago
• jeffknupp / domain-parser
  Parse domains using the TLD list maintained by publicsuffix.org
  ☆61Updated 4 years ago
• bbrodriges / pholcidae
  Tiny python web crawler
  ☆170Updated 8 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 8 years ago
• halit / doorman
  Keeps your secret things
  ☆83Updated 6 years ago
• acdha / python-phash
  ctypes bindings for libphash to robustly compare media files
  ☆12Updated last year
• blha303 / DO-runin
  A tool that starts a DigitalOcean droplet in a given region and runs a given command, displaying the output.
  ☆25Updated 8 years ago
• ssteuteville / scrapyz
  "Scrape Easy" - an extension of the Scrapy framework.
  ☆189Updated 8 years ago
• asyne / cproto
  Chrome Debugging client for Python
  ☆32Updated 5 years ago
• charman / trawler
  Twitter crawler
  ☆11Updated 10 years ago
• alexandrevicenzi / fluentmail
  Python SMTP client and Email for Humans™
  ☆82Updated 5 years ago
• neurogeek / python-crypt-import-hooks
  Python Import Hooks to allow encrypted python modules in your applications. (Experimental stuff)
  ☆33Updated 11 years ago
• TeamHG-Memex / autologin
  A project to attempt to automatically login to a website given a single seed
  ☆123Updated 2 years ago
• mozilla / django-session-csrf
  CSRF protection for Django without cookies.
  ☆110Updated 5 years ago
• not-kennethreitz / elephant
  A persistent, full-text searchable key-value store. Powered by Flask, ElasticSearch, S3, and good intentions.
  ☆481Updated 7 years ago
• matiasb / demiurge
  PyQuery-based scraping micro-framework.
  ☆114Updated 2 years ago
• habnabit / txsocksx
  SOCKS{4,4a,5} endpoints for twisted
  ☆58Updated 4 years ago
• mozilla / elasticutils
  [deprecated] A friendly chainable ElasticSearch interface for python
  ☆243Updated 9 years ago
• tmoravec / fastjsonrpc
  JSON-RPC server and client, written in Python using Twisted
  ☆17Updated 10 years ago
• TeamHG-Memex / fortia
  [UNMAINTAINED] Firefox addon for Scrapely
  ☆5Updated 8 years ago
• furious-luke / django-scrape
  A system to integrate Django with web scraping frameworks, particularly (well only, at the moment) Scrapy.
  ☆21Updated 13 years ago
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 7 years ago
• Octosec / tckfc
  This tool seeks asynchronously TrueCrypt key file using combinations of provided key files with provided password.
  ☆48Updated 6 years ago
• lepture / flask-shorturl
  Short URL generator for Flask.
  ☆33Updated 8 years ago
• Yipit / pyeqs
  Python Elasticsearch Querysets
  ☆207Updated 3 years ago
• joshmarshall / tweetwatcher
  Tiny Tornado site for monitoring Twitter Streaming API with Websockets / long polling
  ☆38Updated 13 years ago