Alternatives and similar repositories for cassandra-scrapy-pipeline:

Users that are interested in cassandra-scrapy-pipeline are comparing it to the libraries listed below

• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated 11 months ago
• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• amwaleh / Simple-stream-Kafka
  This is a simple streaming application that utilises Kafka and Python
  ☆45Updated 6 years ago
• ksindi / kafka-compose
  Docker compose files for various kafka stacks
  ☆32Updated 7 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• dreyco676 / nlp_spark
  Natural Language Processing with Spark's MLlib
  ☆62Updated 7 years ago
• rustyrazorblade / killranalytics
  Open source analytics platform powered by Apache Cassandra, Spark, and Kafka
  ☆34Updated 9 years ago
• greg-gajda / spark-examples
  ☆23Updated 7 years ago
• TargetHolding / pyspark-elastic
  PySpark for Elastic Search
  ☆55Updated 8 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 6 years ago
• Lewuathe / dllib
  dllib is a distributed deep learning library running on Apache Spark
  ☆32Updated 7 years ago
• Mageswaran1989 / awesome-ApacheSpark-collections
  A curated list of awesome Apache Spark packages and resources.
  ☆40Updated 8 years ago
• P7h / StormTweetsSentimentD3Viz
  Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.
  ☆26Updated 10 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• mesosphere-backup / time-series-demo
  A DC/OS time series demo
  ☆62Updated 9 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 9 years ago
• implydata / datazoo
  A collection of datasets and databases
  ☆24Updated 6 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated 10 months ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• felixcheung / spark-notebook-examples
  Some notebook examples related to Apache Spark, IPython / Jupyter, Zeppelin
  ☆52Updated 8 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆35Updated 8 years ago
• iammai / docker-scrapy-crawler
  docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".
  ☆42Updated 9 years ago
• realpython / twitter-sentiment-elasticsearch
  Let's perform Twitter sentiment analysis using Python, Docker, Elasticsearch, and Kibana!
  ☆137Updated 4 years ago
• javanna / elasticshell
  A javascript shell for elasticsearch
  ☆105Updated 9 years ago
• turi-code / spark-sframe
  This project contains the code to translate between Apache Spark and SFrame.
  ☆20Updated 8 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 10 months ago
• scrapinghub / docker-images
  ☆32Updated last year
• octohedron / TouristFriend
  🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!
  ☆29Updated 6 years ago