scrapinghub / kafka-scanner
High Level Kafka Scanner
☆19Updated 7 years ago
Alternatives and similar repositories for kafka-scanner:
Users that are interested in kafka-scanner are comparing it to the libraries listed below
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Scrapy extension which writes crawled items to Kafka☆30Updated 6 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- My capstone project for Galvanize (Zipfian Academy)☆38Updated 6 years ago
- Probabilistic Data Structures in Python (originally presented at PyData 2013)☆55Updated 3 years ago
- A high-performance distributed web crawling & scraping framework written with golang and python.☆30Updated 8 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Store the progress of a job☆16Updated 7 years ago
- A python module that will check for package updates.☆28Updated 3 years ago
- An asynchronous Redis client for Tornado☆20Updated 4 years ago
- Python's missing statistical Swiss Army knife☆15Updated 9 years ago
- A cell magic for futurize☆10Updated 9 years ago
- A very naive classifier to figure out if a sentence contains dirty words☆33Updated 9 years ago
- MapReduce platform in python☆34Updated 9 years ago
- Convert URL's to a normalized unicode format☆67Updated 7 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 9 years ago
- Traptor -- A distributed Twitter feed☆26Updated 2 years ago
- Business Intelligence (BI) in Python (Pandas web interface) - Frontend☆9Updated 9 years ago
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆55Updated 11 months ago
- Low level elasticsearch driver for Python☆107Updated 11 years ago
- Collection of dask example notebooks☆58Updated 7 years ago
- 📑⚙️ Python/Django reference implementation of the ERAV data model☆21Updated 5 years ago
- A Python wrapper for MADlib(http://madlib.net) - an open source library for scalable in-database machine learning algorithms☆63Updated 4 years ago
- 🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!☆29Updated 6 years ago
- Addon to the official elasticsearch python client for X-Pack (deprecated)☆10Updated 6 years ago
- ☆18Updated 8 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Updated 5 years ago