matpalm / common-crawl
playing around with the common crawl dataset
☆70Updated 12 years ago
Alternatives and similar repositories for common-crawl:
Users that are interested in common-crawl are comparing it to the libraries listed below
- ☆116Updated 13 years ago
- Java implementation of a probabilistic set data structure☆143Updated 7 years ago
- Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.☆158Updated 2 years ago
- Bulk loading for elastic search☆185Updated last year
- Social sentiment flagger intended to judge given text as: positive, neutral or negative.☆130Updated 12 years ago
- Redis bulk-loader for Apache Pig☆40Updated 13 years ago
- distributed twitter search engine☆78Updated 13 years ago
- Stream-based InputFormat for processing the compressed XML dumps of Wikipedia with Hadoop☆85Updated 11 years ago
- Some utilities for Lucene☆110Updated 11 years ago
- A restful web application for real-time typeahead and autocomplete☆105Updated 12 years ago
- S4 repository☆141Updated 13 years ago
- GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework☆293Updated 2 years ago
- distributed latent dirichlet allocation☆30Updated 13 years ago
- code for the ml class☆29Updated 13 years ago
- [not maintained] Custom Twitter Search via ElasticSearch&Wicket☆59Updated 4 years ago
- Zohmg is a data store for aggregation of multi-dimensional time series data, built on top of Hadoop, Dumbo and HBase.☆174Updated 12 years ago
- Exception catcher that runs on Google App Engine☆74Updated 11 years ago
- The dead simple, done right, distributed file system.☆121Updated 13 years ago
- ☆40Updated 13 years ago
- Hadoop Input and Ouput formats for MongoDB☆29Updated 13 years ago
- Text clustering service for the web☆25Updated 6 years ago
- Crux is a reporting application for HBase. Crux provides a simple web based graphical interface to access HBase, query data and create re…☆100Updated 12 years ago
- example code for "Large-scale social media analysis with Hadoop" tutorial presented at ICWSM 2010☆42Updated 14 years ago
- Where 2.0 Workshop Code: Spatial Analysis of Tweets using Hadoop, Pig, Python & Mechanical Turk. Slides here: http://www.slideshare.net/…☆134Updated 15 years ago
- Flexible data workflow glue.☆28Updated 13 years ago
- A graph database for python built on top of cassandra☆48Updated 10 years ago
- Mneme is an HTTP web-service for recording and identifying previously seen records - aka, duplicate detection.☆108Updated 11 years ago
- A high performance distributed graph database.☆130Updated 6 years ago
- Install this couchapp on your CouchOne instance to be able to chat friends, discuss events on a map☆39Updated 13 years ago
- Log processing system using Flume and Cassandra☆75Updated 14 years ago