scrapinghub / kafka-scannerLinks
High Level Kafka Scanner
☆19Updated 7 years ago
Alternatives and similar repositories for kafka-scanner
Users that are interested in kafka-scanner are comparing it to the libraries listed below
Sorting:
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Scrapy extension which writes crawled items to Kafka☆30Updated 6 years ago
- My capstone project for Galvanize (Zipfian Academy)☆38Updated 6 years ago
- MapReduce platform in python☆34Updated 9 years ago
- ☆18Updated 8 years ago
- A cell magic for futurize☆10Updated 9 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- Store the progress of a job☆16Updated 7 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Probabilistic Data Structures in Python (originally presented at PyData 2013)☆55Updated 3 years ago
- buildstrap: when buildout+pip=♥☆16Updated 8 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 9 years ago
- Python bindings for TrailDB☆39Updated 5 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 9 years ago
- A python module that will check for package updates.☆28Updated 3 years ago
- A high-performance distributed web crawling & scraping framework written with golang and python.☆30Updated 9 years ago
- common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text☆35Updated 8 years ago
- A tiny python utility that converts data crawled from different services into a cloud of words☆30Updated 7 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Updated 5 years ago
- Simple arithmetic expression parser☆35Updated 3 years ago
- A fork of http://pydispatcher.sourceforge.net/ with PyPy support☆16Updated 7 years ago
- An extended version of the official Elasticsearch Python client.☆63Updated 9 years ago
- Cubes OLAP Examples☆74Updated 6 years ago
- Find elements in HTML by matching them with a skeleton☆25Updated 2 years ago
- A very naive classifier to figure out if a sentence contains dirty words☆33Updated 9 years ago
- A cookiecutter template for Apache Spark applications written in Scala☆10Updated 6 years ago
- Business Intelligence (BI) in Python (Pandas web interface) - Frontend☆10Updated 9 years ago
- 🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!☆29Updated 6 years ago