Alternatives and similar repositories for ccrawler

Users that are interested in ccrawler are comparing it to the libraries listed below

• ncouture / python-search-engine
  Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.
  ☆11Updated 2 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• seomoz / g-crawl-py
  Gevent Crawling in Python, with Utilities
  ☆23Updated 10 years ago
• atmb4u / butler
  Python Dictionaries and Lists on Steroids
  ☆23Updated 10 years ago
• koblas / spiro
  Tornado Web Crawler
  ☆66Updated 12 years ago
• nesaro / pydsl
  Python Domain Specific Language Tools
  ☆84Updated 3 years ago
• ceteri / slinky
  Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi
  ☆41Updated 14 years ago
• scrapinghub / crawlera-tools
  Crawlera tools
  ☆26Updated 9 years ago
• ContinuumIO / scrapy_scrapers
  Scraper built with Scrapy.
  ☆17Updated 9 months ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 7 years ago
• jerith / xpathlet
  Pure Python XPath implementation that operates on ElementTree objects.
  ☆11Updated 10 years ago
• DataBrewery / cubes-examples
  Cubes OLAP Examples
  ☆74Updated 6 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• TeamHG-Memex / fortia
  [UNMAINTAINED] Firefox addon for Scrapely
  ☆5Updated 9 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• marklit / airline-passenger-counts
  Commercial Airline Passenger Counts between airports (for latest year reported, usually 2013)
  ☆32Updated 9 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• Who8MyLunch / Python-Embed-Demo
  Python & Numpy embedded within C++ using Cython as magic glue
  ☆12Updated 11 years ago
• simplegeo / python-geohash
  SimpleGeo's fork of python-geohash (w/East-West fixes)
  ☆57Updated 14 years ago
• vmware-archive / pymadlib
  A Python wrapper for MADlib(http://madlib.net) - an open source library for scalable in-database machine learning algorithms
  ☆63Updated 4 years ago
• niklasb / webkit-server
  [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
  ☆48Updated 4 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• realpython / django-social-auth-example
  Adding Social Authentication to Django
  ☆19Updated 10 years ago
• jehiah / urlnorm
  Convert URL's to a normalized unicode format
  ☆67Updated 7 years ago
• scrapinghub / django-xadmin
  Drop-in replacement of Django admin comes with lots of goodies, fully extensible with plugin support, pretty UI based on Twitter Bootstra…
  ☆9Updated last year
• galeo / pyflit
  A simple Python HTTP downloader that support multi-thread downloading and multi-segment file downloading.
  ☆34Updated 8 years ago
• uber / py-look-for-timeouts
  Scan for missing timeout calls in python source files
  ☆18Updated 5 years ago