whym / wikihadoop
Stream-based InputFormat for processing the compressed XML dumps of Wikipedia with Hadoop
☆86Updated 11 years ago
Related projects: ⓘ
- Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.☆158Updated last year
- playing around with the common crawl dataset☆70Updated 12 years ago
- distributed latent dirichlet allocation☆30Updated 12 years ago
- Bulk loading for elastic search☆186Updated 9 months ago
- S4 repository☆141Updated 12 years ago
- Machine learning and natural language processing with Apache Pig☆53Updated 10 years ago
- Hadoop library for large-scale data processing, now an Apache Incubator project☆584Updated 10 years ago
- Yahoo!'s topic modelling framework using Latent Dirichlet Allocation☆338Updated 13 years ago
- A grouping of Apache Pig examples.☆65Updated 3 years ago
- A Hadoop toolkit for web-scale information retrieval research☆79Updated 9 years ago
- Cloud9 is a Hadoop toolkit for working with big data☆236Updated 8 years ago
- ☆116Updated 12 years ago
- Java implementation of a probabilistic set data structure☆142Updated 7 years ago
- GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework☆293Updated 2 years ago
- ☆210Updated this week
- ☆69Updated this week
- Crux is a reporting application for HBase. Crux provides a simple web based graphical interface to access HBase, query data and create re…☆100Updated 11 years ago
- Some utilities for Lucene☆111Updated 11 years ago
- Examples of use of pig scripting languages capabilities☆39Updated 8 years ago
- Mahout vector encoding for pig☆54Updated last year
- ☆30Updated this week
- Latent Dirichlet Allocation for topic modeling of streamed data sources☆102Updated 9 years ago
- Example code for "Web-Scale Computer Vision using MapReduce for Multimedia Data Mining"☆49Updated 14 years ago
- Pretty fast parser for probabilistic context free grammars☆86Updated 11 years ago
- distributed twitter search engine☆78Updated 13 years ago