Alternatives and similar repositories for warc-hadoop

Users that are interested in warc-hadoop are comparing it to the libraries listed below

• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆282Updated 7 years ago
• algorithmfoundry / Foundry
  The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning
  ☆134Updated 4 years ago
• o19s / lucene-query-example
  Educational Examle of a custom Lucene Query & Scorer
  ☆48Updated 5 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆149Updated 3 years ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• Sotera / correlation-approximation
  Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets
  ☆93Updated 9 years ago
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆217Updated 2 years ago
• sweble / sweble-wikitext
  The Sweble Wikitext Components module provides a parser for MediaWiki's wikitext and an engine trying to emulate the behavior of a MediaW…
  ☆73Updated last year
• rmagen / elastic-gremlin
  TinkerPop 3 implementation on Elasticsearch backend
  ☆70Updated 9 years ago
• dlwh / puck
  Puck is a lightning-fast parser for natural languages using GPUs
  ☆250Updated 10 years ago
• lucidworks / searchhub
  Fusion demo app searching open-source project data from the Apache Software Foundation
  ☆43Updated 6 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆244Updated last week
• datumbox / datumbox-framework-examples
  Code examples on how to use the Datumbox Machine Learning Framework.
  ☆41Updated last year
• sjyk / sampleclean-async
  ☆92Updated 9 years ago
• scalanlp / chalk
  Chalk is a natural language processing library.
  ☆260Updated 8 years ago
• tmbo / deep-nlp-scala
  Using deep learning to POS tag sentences using scala + DL4J
  ☆37Updated 10 years ago
• medale / spark-mail
  Tutorial on parsing Enron email to Avro and then explore the email set using Spark.
  ☆52Updated last year
• emorynlp / nlp4j
  NLP framework for JVM languages.
  ☆149Updated 4 years ago
• knowitall / nlptools
  A toolkit that wraps various natural language processing implementations behind a common interface.
  ☆101Updated 7 years ago
• BIDData / BIDMat
  A CPU and GPU-accelerated matrix library for data mining
  ☆266Updated 4 years ago
• etsy / Conjecture
  Scalable Machine Learning in Scalding
  ☆360Updated 7 years ago
• deepsense-ai / seahorse-workflow-executor
  ☆41Updated 8 years ago
• utcompling / applied-nlp
  Course repository for Applied Natural Language Processing
  ☆125Updated 12 years ago
• amplab / ml-matrix
  Distributed Matrix Library
  ☆72Updated 8 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• ddf-project / DDF
  Distributed DataFrame: Productivity = Power x Simplicity For Scientists & Engineers, on any Data Engine
  ☆167Updated 4 years ago
• eHarmony / aloha
  A scala-based feature generation and modeling framework
  ☆61Updated 6 years ago
• gangeli / CoreNLP-Scala
  A Scala wrapper for CoreNLP
  ☆40Updated 9 years ago
• apache / stanbol
  Mirror of Apache Stanbol (incubating)
  ☆112Updated last year
• jatecs / jatecs
  Java text categorization system
  ☆56Updated 8 years ago