Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below

• aaronsw / pytorctl
  ☆57Updated last year
• papaya-mobile / cyber
  A distributed asynchronous socket framework of Python
  ☆13Updated 8 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 10 months ago
• ssteuteville / scrapyz
  "Scrape Easy" - an extension of the Scrapy framework.
  ☆188Updated 8 years ago
• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 9 years ago
• kakwa / pygraph_redis
  Simple python library to manipulate directed graphs in redis
  ☆23Updated 7 years ago
• bbrodriges / pholcidae
  Tiny python web crawler
  ☆169Updated 8 years ago
• lgiordani / postage
  A RabbitMQ-based component Python library
  ☆33Updated 10 years ago
• getdnsapi / getdns-python-bindings
  Python bindings for getdns
  ☆25Updated 4 years ago
• eklitzke / tornado-dns
  Asynchronous DNS lookups for Tornado
  ☆49Updated 10 years ago
• staceysern / bt-twisted
  A BitTorrent client written in Python using Twisted
  ☆33Updated 10 years ago
• kashifrazzaqui / vyked
  A python asyncio driven service oriented architecture framework
  ☆52Updated 2 years ago
• shish / devtools-py
  A Python client for Chrome's DevTools protocol / a headless chrome control library
  ☆15Updated 6 years ago
• arkaitzj / wsvnc
  In browser VNC client through websockets
  ☆30Updated 13 years ago
• niklasb / webkit-server
  [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
  ☆48Updated 4 years ago
• sunshineatnoon / Scrapy-Amazon-Sqlite
  This is a project crawling backpack information and images from Amazon using python scrapy and store data to sqlite database.
  ☆34Updated 9 years ago
• bcho / donkey
  A simple cron-like library for executing scheduled jobs.
  ☆21Updated 9 years ago
• f-prime / Feather-Python
  A light weight Python web framework.
  ☆10Updated 8 years ago
• walkr / nanoservice
  nanoservice is a small Python library for writing lightweight networked services using nanomsg
  ☆31Updated 9 years ago
• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated last year
• ceteri / slinky
  Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi
  ☆41Updated 14 years ago
• collinalexbell / Email-Autoresponder
  ☆21Updated 9 years ago
• yyuu / botornado
  An asynchronous AWS client on Tornado.
  ☆41Updated 4 years ago
• erijo / transparent-proxy
  A basic transparent HTTP proxy
  ☆51Updated 4 years ago
• gtoonstra / remap
  MapReduce platform in python
  ☆34Updated 9 years ago
• timmartin19 / ripozo-oasis
  A package and tutorial for turning your database into a HATEOAS ReSTful application
  ☆59Updated 9 years ago
• jmehnle / aiohttpproxy
  Simple aiohttp HTTP proxy
  ☆12Updated 10 years ago
• GrahamDumpleton-abandoned / ispyd
  ☆87Updated 11 years ago
• amix / neuralist
  A Python interface to access neural-redis
  ☆79Updated 8 years ago
• coldnight / gredis
  gRedis is an asynchronous client library of Redis written with Tornado coroutine.
  ☆13Updated 5 years ago