Alternatives and similar repositories for ccrawler:

Users that are interested in ccrawler are comparing it to the libraries listed below

• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 8 months ago
• ncouture / python-search-engine
  Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.
  ☆11Updated last year
• CLLKazan / iCQA
  iCQA - Intelligent Community Question Answering Framework
  ☆31Updated 8 years ago
• scrapinghub / crawlera-tools
  Crawlera tools
  ☆26Updated 9 years ago
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• petterw / crawler
  Toy web crawler
  ☆21Updated 13 years ago
• seomoz / g-crawl-py
  Gevent Crawling in Python, with Utilities
  ☆23Updated 9 years ago
• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• koblas / spiro
  Tornado Web Crawler
  ☆66Updated 12 years ago
• MBoustani / Khooshe
  Big GeoSpatial Data Points Visualization Tool
  ☆19Updated 8 years ago
• svetlyak40wt / scrapy-useragents
  A middleware to use random user agent in Scrapy crawler.
  ☆33Updated 12 years ago
• wbond / pymeta3
  A Python 3 compatible fork of https://launchpad.net/pymeta
  ☆18Updated 6 years ago
• scrapinghub / scmongo
  MongoDB extensions for Scrapy
  ☆44Updated 10 years ago
• vdmitriyev / services-to-wordcloud
  A tiny python utility that converts data crawled from different services into a cloud of words
  ☆30Updated 6 years ago
• philberty / vigilant
  Application Driven Stats Monitoring
  ☆229Updated 9 years ago
• scrapinghub / pybloomfiltermmap
  Fast Python Bloom Filter using Mmap
  ☆13Updated 12 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• nicodds / chesf
  CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
  ☆20Updated 7 years ago
• benoitc / flower
  collection of modules to build distributed and reliable concurrent systems in Python.
  ☆206Updated 11 years ago
• solrcloudpy / solrcloudpy
  python library for interacting with SolrCloud
  ☆36Updated 4 years ago
• SerenitySoftware / cahoots
  A Text Comprehension Engine in Python
  ☆15Updated 9 years ago
• papaya-mobile / cyber
  A distributed asynchronous socket framework of Python
  ☆13Updated 8 years ago
• nasa-jpl-memex / memex-gate
  General Architecture for Text Engineering
  ☆48Updated 8 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 6 years ago
• ceteri / slinky
  Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi
  ☆41Updated 14 years ago
• niklasb / webkit-server
  [not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
  ☆48Updated 4 years ago
• scrapinghub / flatson
  Tool to flatten stream of JSON-like objects, configured via schema
  ☆33Updated 5 years ago
• fdintino / pyzipcode
  No longer maintained! See https://bitbucket.org/vangheem/pyzipcode
  ☆20Updated 5 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• Yelp / s3mysqldump
  Dump mysql tables to s3, and parse them
  ☆31Updated 10 years ago