Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below

• bbrodriges / pholcidae
  Tiny python web crawler
  ☆170Updated 8 years ago
• atupal / ccrawler
  A distrubuted crawler ues celery.
  ☆17Updated 10 years ago
• arkaitzj / wsvnc
  In browser VNC client through websockets
  ☆30Updated 13 years ago
• papaya-mobile / cyber
  A distributed asynchronous socket framework of Python
  ☆13Updated 8 years ago
• kakwa / pygraph_redis
  Simple python library to manipulate directed graphs in redis
  ☆23Updated 7 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆65Updated 10 years ago
• yyuu / botornado
  An asynchronous AWS client on Tornado.
  ☆41Updated 4 years ago
• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 9 years ago
• zihuaye / 3xsd
  3xsd is a native epoll server serving TCP/UDP connections, a high performance static web server, a failover dns server, a http-based dist…
  ☆12Updated 7 years ago
• c00w / gevent-dht
  A dht based on gevent.
  ☆42Updated 9 years ago
• atmb4u / butler
  Python Dictionaries and Lists on Steroids
  ☆23Updated 9 years ago
• jianxunio / yascrapy
  A high-performance distributed web crawling & scraping framework written with golang and python.
  ☆30Updated 8 years ago
• Doist / fixedlist
  Fast performance fixed list for Redis
  ☆12Updated 2 years ago
• ncolony / ncolony
  A colony of interacting processes
  ☆23Updated 7 months ago
• eklitzke / tornado-dns
  Asynchronous DNS lookups for Tornado
  ☆49Updated 9 years ago
• gtoonstra / remap
  MapReduce platform in python
  ☆34Updated 9 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 7 months ago
• zdexter / py-bittorrent
  A BitTorrent client written in Python. Supports multi-file torrents and implements a rarest-first piece download strategy.
  ☆30Updated 12 years ago
• feature-flow / twotieredkanban
  Two-tiered Kanban
  ☆20Updated 2 years ago
• ssteuteville / scrapyz
  "Scrape Easy" - an extension of the Scrapy framework.
  ☆189Updated 8 years ago
• cryzed / Feedbuffer
  Feedbuffer buffers RSS and Atom syndication feeds, that is to say it caches new feed entries until the news aggregator requests them and …
  ☆19Updated 8 years ago
• tylerlong / quick_orm
  Python ORM framework which enables you to get started in less than a minute!
  ☆41Updated 11 years ago
• agoragames / kairos
  Python module for time series data in Redis and Mongo
  ☆206Updated 3 years ago
• MartiONE / scrapy-proxy-spiders
  Scrapy proxy crawler with python 3
  ☆19Updated 4 years ago