whym / wikihadoop
Stream-based InputFormat for processing the compressed XML dumps of Wikipedia with Hadoop
☆85Updated 11 years ago
Alternatives and similar repositories for wikihadoop:
Users that are interested in wikihadoop are comparing it to the libraries listed below
- distributed latent dirichlet allocation☆30Updated 13 years ago
- Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.☆158Updated 2 years ago
- playing around with the common crawl dataset☆70Updated 12 years ago
- Bulk loading for elastic search☆185Updated last year
- GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework☆293Updated 2 years ago
- Hadoop library for large-scale data processing, now an Apache Incubator project☆583Updated 10 years ago
- A Hadoop toolkit for web-scale information retrieval research☆82Updated 10 years ago
- Yahoo!'s topic modelling framework using Latent Dirichlet Allocation☆337Updated 13 years ago
- Cloud9 is a Hadoop toolkit for working with big data☆237Updated 9 years ago
- Twitter Tools☆218Updated 7 years ago
- Examples of use of pig scripting languages capabilities☆39Updated 8 years ago
- Java implementation of a probabilistic set data structure☆143Updated 7 years ago
- Machine learning and natural language processing with Apache Pig☆53Updated 11 years ago
- S4 repository☆141Updated 13 years ago
- Rails app for tracking trends in server logs - powered by the Cloudera Hadoop Distribution on EC2☆355Updated 13 years ago
- A grouping of Apache Pig examples.☆65Updated 4 years ago
- Some utilities for Lucene☆110Updated 11 years ago
- Crux is a reporting application for HBase. Crux provides a simple web based graphical interface to access HBase, query data and create re…☆100Updated 11 years ago
- Continuous Streaming SQL Queries for Flume☆95Updated 13 years ago
- ☆116Updated 13 years ago
- Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a …☆50Updated 13 years ago
- Zohmg is a data store for aggregation of multi-dimensional time series data, built on top of Hadoop, Dumbo and HBase.☆174Updated 12 years ago
- Hadoop Input and Ouput formats for MongoDB☆29Updated 13 years ago
- code for the ml class☆29Updated 13 years ago
- Latent Dirichlet Allocation for topic modeling of streamed data sources☆100Updated 9 years ago
- Redis bulk-loader for Apache Pig☆40Updated 12 years ago
- Common Crawl support library to access 2008-2012 crawl archives (ARC files)☆495Updated 7 years ago
- A flexible, partial, out-of-order and real-time typeahead search library☆564Updated 11 years ago
- Mavuno: A Hadoop-Based Text Mining Toolkit☆47Updated 13 years ago
- Mahout vector encoding for pig☆54Updated 2 years ago