Alternatives and similar repositories for cassandra-scrapy-pipeline

Users that are interested in cassandra-scrapy-pipeline are comparing it to the libraries listed below

• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• sloanahrens / qbox-blog-code
  Code reference from my Qbox blog posts.
  ☆87Updated 10 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• dreyco676 / nlp_spark
  Natural Language Processing with Spark's MLlib
  ☆62Updated 8 years ago
• rholder / csv2es
  Load a CSV (or TSV) file into an Elasticsearch instance
  ☆62Updated 3 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 7 years ago
• javanna / elasticshell
  A javascript shell for elasticsearch
  ☆106Updated 10 years ago
• realpython / twitter-sentiment-elasticsearch
  Let's perform Twitter sentiment analysis using Python, Docker, Elasticsearch, and Kibana!
  ☆138Updated 5 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• TargetHolding / pyspark-elastic
  PySpark for Elastic Search
  ☆55Updated 8 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 3 years ago
• amwaleh / Simple-stream-Kafka
  This is a simple streaming application that utilises Kafka and Python
  ☆46Updated 6 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated 2 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 6 years ago
• mnielsen / ec2_tools
  Deprecated. Formerly: scripts to make it easier to set up and manipulate clusters at Amazon EC2
  ☆110Updated 13 years ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 9 years ago
• memsql / memsql-python
  This repository holds some python libraries and plugins designed to be used with MemSQL.
  ☆62Updated 2 years ago
• pandastrike / bayzee
  Text classification using Naive Bayes and Elasticsearch
  ☆152Updated 9 years ago
• AirSage / Petrel
  Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python
  ☆246Updated 2 years ago
• ksindi / kafka-compose
  Docker compose files for various kafka stacks
  ☆32Updated 7 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• IgorBerman / spark-gotchas
  Few things we've met during our etl project based on spark
  ☆24Updated 7 years ago
• wingify / superelasticsearch
  An extended version of the official Elasticsearch Python client.
  ☆63Updated 10 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 6 years ago
• svenkreiss / databench
  Data analysis tool.
  ☆85Updated 2 years ago
• unnati-xyz / luigi-sample
  Sample repo for luigi tasks & config
  ☆36Updated 9 years ago
• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 3 years ago
• KristianHolsheimer / pyspark-setup-guide
  A guide for setting up Spark + PySpark under Ubuntu linux
  ☆56Updated 8 years ago
• bonzanini / luigi-slack
  Slack notifications for the Luigi workflow manager
  ☆46Updated 4 years ago