Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below

• atupal / ccrawler
  A distrubuted crawler ues celery.
  ☆17Updated 10 years ago
• arkaitzj / wsvnc
  In browser VNC client through websockets
  ☆30Updated 13 years ago
• atmb4u / butler
  Python Dictionaries and Lists on Steroids
  ☆23Updated 9 years ago
• kakwa / pygraph_redis
  Simple python library to manipulate directed graphs in redis
  ☆23Updated 7 years ago
• bbrodriges / pholcidae
  Tiny python web crawler
  ☆169Updated 8 years ago
• collinalexbell / Email-Autoresponder
  ☆21Updated 10 years ago
• csirtfoundry / BulkWhois
  Python interfaces to popular bulk WHOIS servers such as Shadowserver and Team Cymru.
  ☆21Updated 13 years ago
• TeamHG-Memex / soft404
  A classifier for detecting soft 404 pages
  ☆57Updated last year
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 11 months ago
• amazon-archives / tesserpy
  ARCHIVED: A Python API for Tesseract
  ☆20Updated 7 years ago
• lamflam / rq-scheduler-dashboard
  A dashboard for rq-scheduler jobs
  ☆17Updated 2 years ago
• getdnsapi / getdns-python-bindings
  Python bindings for getdns
  ☆25Updated 4 years ago
• f-prime / MatchBox
  Project now called IonicBackup
  ☆285Updated 12 years ago
• acdha / python-phash
  ctypes bindings for libphash to robustly compare media files
  ☆12Updated 2 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• yspanchal / docli
  Digital Ocean Command Line Interface
  ☆32Updated last year
• humangeo / rawes
  Low level elasticsearch driver for Python
  ☆107Updated 11 years ago
• smontanaro / python-bits
  Stuff I originally stored on my personal website
  ☆12Updated 2 years ago
• walkr / nanoservice
  nanoservice is a small Python library for writing lightweight networked services using nanomsg
  ☆31Updated 9 years ago
• ncolony / ncolony
  A colony of interacting processes
  ☆23Updated 10 months ago
• CIRCL / email-abuse
  Email Abuse - A Versatile Software for Email review, analysis and reporting
  ☆21Updated 9 years ago
• twisted / axiom
  Divmod Axiom is an object database, or alternatively, an object-relational mapper, implemented on top of Python.
  ☆23Updated 2 years ago
• deavid / bjsonrpc
  JSON-RPC implementation over TCP/IP (asyncronous, bidirectional)
  ☆39Updated 9 years ago
• gtoonstra / remap
  MapReduce platform in python
  ☆34Updated 9 years ago
• rmax / databrewer
  The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!
  ☆39Updated 7 years ago
• Muterra / py_smartyparse
  Smartyparse: A python library for smart dynamic binary de/encoding.
  ☆15Updated 7 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• avelino / bottle-auth
  Bootle authentication, for Personal, Google, Twitter and facebook
  ☆29Updated 8 years ago
• rasguanabana / function-pattern-matching
  Pattern matching and guards for Python functions
  ☆30Updated 8 years ago
• niklasb / webkit-server
  [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
  ☆48Updated 4 years ago