dansandland / cassandra-scrapy-pipelineLinks
☆15Updated 9 years ago
Alternatives and similar repositories for cassandra-scrapy-pipeline
Users that are interested in cassandra-scrapy-pipeline are comparing it to the libraries listed below
Sorting:
- High Level Kafka Scanner☆19Updated 7 years ago
- Scrapy extension which writes crawled items to Kafka☆30Updated 6 years ago
- a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine☆97Updated last year
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Spark Application : Spark Summit 2018 : Streaming Trend Discovery☆11Updated 6 years ago
- A cookiecutter template for Apache Spark applications written in Scala☆10Updated 6 years ago
- Send summary messages of your Luigi jobs to Slack☆46Updated 6 years ago
- dllib is a distributed deep learning library running on Apache Spark☆32Updated 7 years ago
- Deprecated - Check out MemSQL Pipelines instead!☆8Updated 7 years ago
- 🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!☆29Updated 6 years ago
- ☆32Updated last year
- Beyond Piwik Analytics with Scala and Apache Spark☆46Updated 10 years ago
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆55Updated last year
- A curated list of awesome Apache Spark packages and resources.☆40Updated 8 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- A javascript shell for elasticsearch☆105Updated 10 years ago
- A very naive classifier to figure out if a sentence contains dirty words☆33Updated 9 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Updated last year
- VoltDB Click Stream Processing Example.☆16Updated 7 years ago
- Let's perform Twitter sentiment analysis using Python, Docker, Elasticsearch, and Kibana!☆137Updated 4 years ago
- Natural Language Processing with Spark's MLlib☆62Updated 7 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- Fetch and plot AWS spot pricing history☆23Updated 8 years ago
- a SQL-like command line client for elasticsearch☆46Updated 6 years ago
- A scrapy pipeline which send items to Elastic Search server☆98Updated 7 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- A platform for real-time streaming search☆103Updated 9 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆42Updated 10 years ago
- Open source analytics platform powered by Apache Cassandra, Spark, and Kafka☆34Updated 10 years ago
- ☆14Updated 8 years ago