Alternatives and similar repositories for cassandra-scrapy-pipeline

Users that are interested in cassandra-scrapy-pipeline are comparing it to the libraries listed below

• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• newfront / spark-summit-2018
  Spark Application : Spark Summit 2018 : Streaming Trend Discovery
  ☆11Updated 6 years ago
• jpzk / cookiecutter-scala-spark
  A cookiecutter template for Apache Spark applications written in Scala
  ☆10Updated 6 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 6 years ago
• Lewuathe / dllib
  dllib is a distributed deep learning library running on Apache Spark
  ☆32Updated 7 years ago
• memsql / memsql-loader
  Deprecated - Check out MemSQL Pipelines instead!
  ☆8Updated 7 years ago
• octohedron / TouristFriend
  🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!
  ☆29Updated 6 years ago
• scrapinghub / docker-images
  ☆32Updated last year
• skrusche63 / spark-piwik
  Beyond Piwik Analytics with Scala and Apache Spark
  ☆46Updated 10 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• Mageswaran1989 / awesome-ApacheSpark-collections
  A curated list of awesome Apache Spark packages and resources.
  ☆40Updated 8 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 8 years ago
• javanna / elasticshell
  A javascript shell for elasticsearch
  ☆105Updated 10 years ago
• reddragon / is-dirty
  A very naive classifier to figure out if a sentence contains dirty words
  ☆33Updated 9 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• VoltDB / app-fastdata
  VoltDB Click Stream Processing Example.
  ☆16Updated 7 years ago
• realpython / twitter-sentiment-elasticsearch
  Let's perform Twitter sentiment analysis using Python, Docker, Elasticsearch, and Kibana!
  ☆137Updated 4 years ago
• dreyco676 / nlp_spark
  Natural Language Processing with Spark's MLlib
  ☆62Updated 7 years ago
• turi-code / spark-sframe
  This project contains the code to translate between Apache Spark and SFrame.
  ☆20Updated 8 years ago
• EntilZha / spot-price-reporter
  Fetch and plot AWS spot pricing history
  ☆23Updated 8 years ago
• raff / elseql
  a SQL-like command line client for elasticsearch
  ☆46Updated 6 years ago
• julien-duponchelle / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆98Updated 7 years ago
• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 2 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 9 years ago
• iammai / docker-scrapy-crawler
  docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".
  ☆42Updated 10 years ago
• rustyrazorblade / killranalytics
  Open source analytics platform powered by Apache Cassandra, Spark, and Kafka
  ☆34Updated 10 years ago
• ActivisionGameScience / python-kafka-benchmark
  ☆14Updated 8 years ago