whym / wikihadoopLinks
Stream-based InputFormat for processing the compressed XML dumps of Wikipedia with Hadoop
☆85Updated 12 years ago
Alternatives and similar repositories for wikihadoop
Users that are interested in wikihadoop are comparing it to the libraries listed below
Sorting:
- playing around with the common crawl dataset☆70Updated 13 years ago
- distributed latent dirichlet allocation☆30Updated 14 years ago
- Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.☆161Updated 3 years ago
- Yahoo!'s topic modelling framework using Latent Dirichlet Allocation☆337Updated 14 years ago
- GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework☆294Updated 3 years ago
- Bulk loading for elastic search☆185Updated 2 years ago
- Hadoop library for large-scale data processing, now an Apache Incubator project☆582Updated 11 years ago
- Common Crawl support library to access 2008-2012 crawl archives (ARC files)☆506Updated 8 years ago
- Rails app for tracking trends in server logs - powered by the Cloudera Hadoop Distribution on EC2☆357Updated 14 years ago
- Cloud9 is a Hadoop toolkit for working with big data☆236Updated 10 years ago
- S4 repository☆141Updated 14 years ago
- Twitter Tools☆221Updated 7 years ago
- A Hadoop toolkit for web-scale information retrieval research☆84Updated 11 years ago
- A grouping of Apache Pig examples.☆65Updated 5 years ago
- Java implementation of a probabilistic set data structure☆145Updated 8 years ago
- distributed twitter search engine☆78Updated 14 years ago
- ☆116Updated 13 years ago
- MADlib has moved to Apache MADlib (incubating). Please send pull requests to the Apache repository.☆508Updated 7 years ago
- Code and slides in support of Data Bootcamp tutorial at Strata Conference 2011☆94Updated 14 years ago
- Some utilities for Lucene☆111Updated 12 years ago
- Examples of use of pig scripting languages capabilities☆39Updated 9 years ago
- Latent Dirichlet Allocation for topic modeling of streamed data sources☆101Updated 10 years ago
- Where 2.0 Workshop Code: Spatial Analysis of Tweets using Hadoop, Pig, Python & Mechanical Turk. Slides here: http://www.slideshare.net/…☆134Updated 15 years ago
- Crux is a reporting application for HBase. Crux provides a simple web based graphical interface to access HBase, query data and create re…☆100Updated 12 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- Machine learning and natural language processing with Apache Pig☆53Updated 12 years ago
- Solandra = Solr + Cassandra☆881Updated 9 years ago
- Redis bulk-loader for Apache Pig☆40Updated 13 years ago
- A Python wrapper for Cascading☆222Updated 6 years ago
- Example code for "Web-Scale Computer Vision using MapReduce for Multimedia Data Mining"☆49Updated 15 years ago