matpalm / common-crawlLinks
playing around with the common crawl dataset
☆70Updated 12 years ago
Alternatives and similar repositories for common-crawl
Users that are interested in common-crawl are comparing it to the libraries listed below
Sorting:
- ☆116Updated 13 years ago
- GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework☆293Updated 3 years ago
- Java implementation of a probabilistic set data structure☆144Updated 8 years ago
- Some utilities for Lucene☆110Updated 12 years ago
- The API, BackOffice, Storefront, and Nebulizer for IndexTank☆382Updated 12 years ago
- distributed twitter search engine☆78Updated 14 years ago
- Stream-based InputFormat for processing the compressed XML dumps of Wikipedia with Hadoop☆85Updated 12 years ago
- Rails app for tracking trends in server logs - powered by the Cloudera Hadoop Distribution on EC2☆355Updated 14 years ago
- Bulk loading for elastic search☆185Updated last year
- Redis bulk-loader for Apache Pig☆40Updated 13 years ago
- Social sentiment flagger intended to judge given text as: positive, neutral or negative.☆130Updated 13 years ago
- Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.☆158Updated 2 years ago
- A flexible, partial, out-of-order and real-time typeahead search library☆566Updated 11 years ago
- S4 repository☆141Updated 13 years ago
- Hadoop library for large-scale data processing, now an Apache Incubator project☆582Updated 11 years ago
- Common Crawl support library to access 2008-2012 crawl archives (ARC files)☆502Updated 7 years ago
- distributed latent dirichlet allocation☆30Updated 13 years ago
- This is an educational example of a data mining web application: when is good time to post on HN☆359Updated 12 years ago
- A graph database for python built on top of cassandra☆49Updated 10 years ago
- Yahoo!'s topic modelling framework using Latent Dirichlet Allocation☆337Updated 13 years ago
- A restful web application for real-time typeahead and autocomplete☆105Updated 12 years ago
- Hadoop Input and Ouput formats for MongoDB☆29Updated 13 years ago
- [not maintained] Custom Twitter Search via ElasticSearch&Wicket☆60Updated 4 years ago
- code for the ml class☆29Updated 14 years ago
- Zohmg is a data store for aggregation of multi-dimensional time series data, built on top of Hadoop, Dumbo and HBase.☆173Updated 12 years ago
- example code for "Large-scale social media analysis with Hadoop" tutorial presented at ICWSM 2010☆42Updated 15 years ago
- Exception catcher that runs on Google App Engine☆74Updated 12 years ago
- ☆40Updated 13 years ago
- Indexing engine for IndexTank☆849Updated 13 years ago
- Cloud9 is a Hadoop toolkit for working with big data☆236Updated 9 years ago