dansandland / cassandra-scrapy-pipelineLinks
☆15Updated 9 years ago
Alternatives and similar repositories for cassandra-scrapy-pipeline
Users that are interested in cassandra-scrapy-pipeline are comparing it to the libraries listed below
Sorting:
- A platform for real-time streaming search☆102Updated 9 years ago
- a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine☆97Updated last year
- Code reference from my Qbox blog posts.☆87Updated 10 years ago
- Automatic Item List Extraction☆87Updated 9 years ago
- Natural Language Processing with Spark's MLlib☆62Updated 8 years ago
- Text classification using Naive Bayes and Elasticsearch☆154Updated 9 years ago
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆55Updated last year
- Let's perform Twitter sentiment analysis using Python, Docker, Elasticsearch, and Kibana!☆137Updated 5 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Updated 2 years ago
- A Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, trainin…☆100Updated 2 years ago
- Docker compose files for various kafka stacks☆32Updated 7 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- This is a simple streaming application that utilises Kafka and Python☆46Updated 6 years ago
- A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub☆67Updated 7 years ago
- Scrapy extension which writes crawled items to Kafka☆30Updated 6 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆42Updated 10 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- High Level Kafka Scanner☆19Updated 8 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆91Updated 3 years ago
- Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python☆246Updated 2 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated last year
- Readability/Boilerpipe extraction in Python☆55Updated 9 years ago
- Traptor -- A distributed Twitter feed☆26Updated 3 years ago
- A scrapy pipeline which send items to Elastic Search server☆98Updated 7 years ago
- Small demo for a "search-as-you-type" app in AngularJS + Python/Flask + Elasticsearch☆69Updated 8 years ago
- Scrapy Eagle is a tool that allow us to run any Scrapy based project in a distributed fashion and monitor how it is going on and how many…☆24Updated 5 years ago
- Some notebook examples related to Apache Spark, IPython / Jupyter, Zeppelin☆52Updated 9 years ago
- Public code files for the DDL blog☆56Updated 7 years ago