Alternatives and similar repositories for common-crawl

Users that are interested in common-crawl are comparing it to the libraries listed below

• cathywu / Sentiment-Analysis
  ☆116Updated 13 years ago
• jzachr / goldenorb
  GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework
  ☆292Updated 3 years ago
• Cue / greplin-bloom-filter
  Java implementation of a probabilistic set data structure
  ☆144Updated 8 years ago
• javasoze / chirper
  distributed twitter search engine
  ☆78Updated 14 years ago
• LinkedInAttic / indextank-service
  The API, BackOffice, Storefront, and Nebulizer for IndexTank
  ☆382Updated 12 years ago
• whym / wikihadoop
  Stream-based InputFormat for processing the compressed XML dumps of Wikipedia with Hadoop
  ☆85Updated 12 years ago
• Cue / greplin-lucene-utils
  Some utilities for Lucene
  ☆111Updated 12 years ago
• lrvick / synt
  Social sentiment flagger intended to judge given text as: positive, neutral or negative.
  ☆130Updated 13 years ago
• mattb / pig-redis
  Redis bulk-loader for Apache Pig
  ☆40Updated 13 years ago
• infochimps-labs / wonderdog
  Bulk loading for elastic search
  ☆185Updated last year
• karussell / Jetwick
  [not maintained] Custom Twitter Search via ElasticSearch&Wicket
  ☆60Updated 4 years ago
• datawrangling / trendingtopics
  Rails app for tracking trends in server logs - powered by the Cloudera Hadoop Distribution on EC2
  ☆356Updated 14 years ago
• LinkedInAttic / datafu
  Hadoop library for large-scale data processing, now an Apache Incubator project
  ☆583Updated 11 years ago
• commoncrawl / commoncrawl
  Common Crawl support library to access 2008-2012 crawl archives (ARC files)
  ☆500Updated 7 years ago
• jingwei / cleo-primer
  A restful web application for real-time typeahead and autocomplete
  ☆105Updated 12 years ago
• entaroadun / hnpickup
  This is an educational example of a data mining web application: when is good time to post on HN
  ☆359Updated 12 years ago
• josephreisinger / dist_lda
  distributed latent dirichlet allocation
  ☆30Updated 13 years ago
• s4 / s4
  S4 repository
  ☆141Updated 13 years ago
• globusonline / agamemnon
  A graph database for python built on top of cassandra
  ☆49Updated 10 years ago
• LinkedInAttic / cleo
  A flexible, partial, out-of-order and real-time typeahead search library
  ☆567Updated 11 years ago
• interllective / MongoReduce
  Hadoop Input and Ouput formats for MongoDB
  ☆29Updated 13 years ago
• zohmg / zohmg
  Zohmg is a data store for aggregation of multi-dimensional time series data, built on top of Hadoop, Dumbo and HBase.
  ☆173Updated 12 years ago
• ogrisel / pignlproc
  Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.
  ☆159Updated 2 years ago
• sudar / Yahoo_LDA
  Yahoo!'s topic modelling framework using Latent Dirichlet Allocation
  ☆338Updated 13 years ago
• ultrasaurus / ml_class
  code for the ml class
  ☆29Updated 14 years ago
• Cue / greplin-exception-catcher
  Exception catcher that runs on Google App Engine
  ☆74Updated 12 years ago
• LinkedInAttic / indextank-engine
  Indexing engine for IndexTank
  ☆849Updated 13 years ago
• gparker / vowpal_wabbit
  John Langford's original release of Vowpal Wabbit -- a fast online learning algorithm
  ☆57Updated last year
• mdeiters / neo4jr-social
  Neo4jr-Social is a self contained HTTP REST + JSON interface to the graph database Neo4j. Neo4jr-Social supports simple dynamic node crea…
  ☆167Updated 15 years ago
• alienrobotwizard / swineherd
  Flexible data workflow glue.
  ☆28Updated 14 years ago