scrapinghub / kafka-scanner
High Level Kafka Scanner
☆19Updated 7 years ago
Alternatives and similar repositories for kafka-scanner:
Users that are interested in kafka-scanner are comparing it to the libraries listed below
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Modularly extensible semantic metadata validator☆83Updated 9 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- Automated NLP sentiment predictions- batteries included, or use your own data☆18Updated 7 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- My capstone project for Galvanize (Zipfian Academy)☆38Updated 6 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Python's missing statistical Swiss Army knife☆15Updated 9 years ago
- A tiny python utility that converts data crawled from different services into a cloud of words☆30Updated 6 years ago
- Convert URL's to a normalized unicode format☆67Updated 7 years ago
- A high-performance distributed web crawling & scraping framework written with golang and python.☆30Updated 8 years ago
- Scrapy extension which writes crawled items to Kafka☆30Updated 6 years ago
- Collection of dask example notebooks☆58Updated 7 years ago
- A Python library for dealing with splittable files☆42Updated 5 years ago
- Proposals for new Jupyter subprojects to enter into incubation☆18Updated 4 years ago
- A python module that will check for package updates.☆28Updated 3 years ago
- unofficial git mirror of http://svn.whoosh.ca svn repo☆49Updated 15 years ago
- An extended version of the official Elasticsearch Python client.☆63Updated 9 years ago
- Probabilistic Data Structures in Python (originally presented at PyData 2013)☆55Updated 3 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 9 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Updated 5 years ago
- A cookiecutter template for Apache Spark applications written in Scala☆10Updated 6 years ago
- Store the progress of a job☆16Updated 7 years ago
- ☆18Updated 8 years ago
- common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text☆35Updated 8 years ago
- PyConUK 2016 talk - Using Machine Learning to solve a classification problem with scikit-learn - a practical walkthrough☆18Updated 8 years ago
- Traptor -- A distributed Twitter feed☆26Updated 2 years ago
- Data analysis tool.☆84Updated 2 years ago
- Experimental parallel data analysis toolkit.☆121Updated 3 years ago