Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below

• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 9 months ago
• feature-flow / twotieredkanban
  Two-tiered Kanban
  ☆20Updated 2 years ago
• arkaitzj / wsvnc
  In browser VNC client through websockets
  ☆30Updated 13 years ago
• getdnsapi / getdns-python-bindings
  Python bindings for getdns
  ☆25Updated 4 years ago
• davehunt / pytest-zap
  OWASP Zed Attack Proxy plugin for py.test
  ☆12Updated 9 years ago
• kakwa / pygraph_redis
  Simple python library to manipulate directed graphs in redis
  ☆23Updated 7 years ago
• orf / simple
  Simple is a clone of Obtvse written in Python running on Flask.
  ☆506Updated 6 years ago
• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 9 years ago
• shish / devtools-py
  A Python client for Chrome's DevTools protocol / a headless chrome control library
  ☆15Updated 6 years ago
• joshmarshall / tweetwatcher
  Tiny Tornado site for monitoring Twitter Streaming API with Websockets / long polling
  ☆38Updated 13 years ago
• humangeo / rawes
  Low level elasticsearch driver for Python
  ☆107Updated 10 years ago
• atupal / ccrawler
  A distrubuted crawler ues celery.
  ☆17Updated 10 years ago
• charman / trawler
  Twitter crawler
  ☆11Updated 10 years ago
• vaulstein / 7daysOfCode
  #7DaysOfCode Challenge. Next step #100DaysOfCode
  ☆11Updated 7 years ago
• collinalexbell / Email-Autoresponder
  ☆21Updated 9 years ago
• agoragames / kairos
  Python module for time series data in Redis and Mongo
  ☆206Updated 3 years ago
• JustinAzoff / pynfdump
  python wrapper for the nfdump cli application
  ☆21Updated 3 years ago
• deavid / bjsonrpc
  JSON-RPC implementation over TCP/IP (asyncronous, bidirectional)
  ☆39Updated 9 years ago
• isaiah / bjoern-py3
  A screamingly fast Python WSGI server written in C. Ported to Python3
  ☆14Updated 11 years ago
• eklitzke / tornado-dns
  Asynchronous DNS lookups for Tornado
  ☆49Updated 9 years ago
• MartiONE / scrapy-proxy-spiders
  Scrapy proxy crawler with python 3
  ☆19Updated 4 years ago
• niklasb / webkit-server
  [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
  ☆48Updated 4 years ago
• papaya-mobile / cyber
  A distributed asynchronous socket framework of Python
  ☆13Updated 8 years ago
• bbrodriges / pholcidae
  Tiny python web crawler
  ☆169Updated 8 years ago
• scrapinghub / django-xadmin
  Drop-in replacement of Django admin comes with lots of goodies, fully extensible with plugin support, pretty UI based on Twitter Bootstra…
  ☆9Updated 9 months ago
• gsko / DHTBot
  ☆43Updated 12 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• hawkowl / rproxy
  A HTTP reverse proxy with TLS+SNI support.
  ☆39Updated 5 years ago
• Muterra / py_smartyparse
  Smartyparse: A python library for smart dynamic binary de/encoding.
  ☆15Updated 6 years ago
• srounet / Flask-Analytics
  A Flask extention that provide user navigation tracking
  ☆19Updated 13 years ago