Alternatives and similar repositories for cassandra-scrapy-pipeline

Users that are interested in cassandra-scrapy-pipeline are comparing it to the libraries listed below

• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• sloanahrens / qbox-blog-code
  Code reference from my Qbox blog posts.
  ☆87Updated 10 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• TargetHolding / pyspark-elastic
  PySpark for Elastic Search
  ☆55Updated 8 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• AndrejAndb / google-rtb-requester
  ☆19Updated 11 years ago
• newfront / spark-summit-2018
  Spark Application : Spark Summit 2018 : Streaming Trend Discovery
  ☆11Updated 7 years ago
• IgorBerman / spark-gotchas
  Few things we've met during our etl project based on spark
  ☆24Updated 7 years ago
• NeuralKnot / algo-trading-pipeline
  Algorithmic Trading Pipeline for Online Betting Markets
  ☆19Updated 2 years ago
• octohedron / TouristFriend
  🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!
  ☆29Updated 6 years ago
• rbranson / kombu-multibroker
  Support for multiple broker hosts and basic "failover" on the client side.
  ☆22Updated 12 years ago
• rafaelcapucho / scrapy-eagle
  Scrapy Eagle is a tool that allow us to run any Scrapy based project in a distributed fashion and monitor how it is going on and how many…
  ☆24Updated 4 years ago
• jpzk / cookiecutter-scala-spark
  A cookiecutter template for Apache Spark applications written in Scala
  ☆10Updated 6 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• dreyco676 / nlp_spark
  Natural Language Processing with Spark's MLlib
  ☆62Updated 7 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• RedisLabs / spark-redis-ml
  A spark package for loading Spark ML models to Redis-ML
  ☆63Updated 6 years ago
• logicalclocks / hops-tensorflow
  HopsYARN Tensorflow Framework.
  ☆31Updated 5 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 2 years ago
• ActivisionGameScience / python-kafka-benchmark
  ☆14Updated 9 years ago
• Lewuathe / dllib
  dllib is a distributed deep learning library running on Apache Spark
  ☆32Updated 7 years ago
• drelu / webhdfs-py
  Python Client for WebHDFS REST API
  ☆43Updated 10 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 9 years ago
• rustyrazorblade / killranalytics
  Open source analytics platform powered by Apache Cassandra, Spark, and Kafka
  ☆34Updated 10 years ago
• implydata / datazoo
  A collection of datasets and databases
  ☆24Updated 7 years ago
• javanna / elasticshell
  A javascript shell for elasticsearch
  ☆105Updated 10 years ago