Alternatives and similar repositories for ccrawler:

Users that are interested in ccrawler are comparing it to the libraries listed below

• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 11 months ago
• ncouture / python-search-engine
  Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.
  ☆11Updated last year
• petterw / crawler
  Toy web crawler
  ☆21Updated 13 years ago
• scrapinghub / flatson
  Tool to flatten stream of JSON-like objects, configured via schema
  ☆33Updated 5 years ago
• scrapinghub / pybloomfiltermmap
  Fast Python Bloom Filter using Mmap
  ☆13Updated 12 years ago
• koblas / spiro
  Tornado Web Crawler
  ☆66Updated 12 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• grafos-ml / frappe
  Recommendations Serving Engine using python
  ☆28Updated 9 years ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• scrapinghub / crawlera-tools
  Crawlera tools
  ☆26Updated 9 years ago
• jaysw / ipydb
  Turn your IPython console into a cross-database SQL client
  ☆31Updated 8 years ago
• solrcloudpy / solrcloudpy
  python library for interacting with SolrCloud
  ☆36Updated 4 years ago
• uber / py-look-for-timeouts
  Scan for missing timeout calls in python source files
  ☆18Updated 5 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• svetlyak40wt / scrapy-useragents
  A middleware to use random user agent in Scrapy crawler.
  ☆33Updated 12 years ago
• alexandrevicenzi / fluentmail
  Python SMTP client and Email for Humans™
  ☆82Updated 6 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 6 years ago
• niklasb / webkit-server
  [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
  ☆48Updated 4 years ago
• nathanielobrown / flask-terminado
  Integrates terminado (a web based terminal) with flask
  ☆15Updated 7 years ago
• odie5533 / WarcMiddleware
  WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.
  ☆46Updated 7 years ago
• DataBrewery / cubes-examples
  Cubes OLAP Examples
  ☆74Updated 6 years ago
• philberty / vigilant
  Application Driven Stats Monitoring
  ☆230Updated 9 years ago
• GambitResearch / suponoff
  Supervisor On/Off: an alternative web interface for supervisor
  ☆51Updated 8 years ago
• dmotitsk / coursera
  Coursera materials downloader.
  ☆58Updated 2 years ago
• ericwhyne / http-ricochet
  A simple proxy web service in 19 lines of Python code.
  ☆23Updated 10 years ago
• seomoz / g-crawl-py
  Gevent Crawling in Python, with Utilities
  ☆23Updated 10 years ago
• benoitc / flower
  collection of modules to build distributed and reliable concurrent systems in Python.
  ☆205Updated 11 years ago
• nmichalov / Search-Engine
  A crawler, indexer, and query interface all in Python with distributed processing via Pyro4.
  ☆23Updated 13 years ago
• realpython / django-social-auth-example
  Adding Social Authentication to Django
  ☆19Updated 10 years ago