Alternatives and similar repositories for warc-hadoop:

Users that are interested in warc-hadoop are comparing it to the libraries listed below

• dlwh / puck
  Puck is a lightning-fast parser for natural languages using GPUs
  ☆248Updated 10 years ago
• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆281Updated 6 years ago
• Sotera / correlation-approximation
  Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets
  ☆92Updated 9 years ago
• gangeli / CoreNLP-Scala
  A Scala wrapper for CoreNLP
  ☆40Updated 9 years ago
• utcompling / Scalabha
  Scala utilities for teaching computational linguistics and prototyping algorithms.
  ☆42Updated 12 years ago
• commoncrawl / example-warc-java
  ☆49Updated 7 years ago
• knowitall / nlptools
  A toolkit that wraps various natural language processing implementations behind a common interface.
  ☆101Updated 7 years ago
• tmbo / deep-nlp-scala
  Using deep learning to POS tag sentences using scala + DL4J
  ☆37Updated 9 years ago
• algorithmfoundry / Foundry
  The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning
  ☆132Updated 3 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆148Updated 3 years ago
• apache / stanbol
  Mirror of Apache Stanbol (incubating)
  ☆112Updated 11 months ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 8 years ago
• deepsense-ai / seahorse-workflow-executor
  ☆41Updated 7 years ago
• emorynlp / nlp4j
  NLP framework for JVM languages.
  ☆148Updated 3 years ago
• emorynlp / nlp4j-old
  NLP tools developed by Emory University.
  ☆60Updated 8 years ago
• momer / nutch-selenium
  ☆28Updated 8 years ago
• sweble / sweble-wikitext
  The Sweble Wikitext Components module provides a parser for MediaWiki's wikitext and an engine trying to emulate the behavior of a MediaW…
  ☆71Updated 10 months ago
• melix / jlangdetect
  A language detection library for the JVM
  ☆36Updated last year
• jatecs / jatecs
  Java text categorization system
  ☆55Updated 7 years ago
• scalanlp / chalk
  Chalk is a natural language processing library.
  ☆258Updated 8 years ago
• maxdemarzi / graph_processing
  Graph Processing Algorithms on top of Neo4j
  ☆39Updated 7 years ago
• kifi / ReactiveLDA
  ReactiveLDA is a fast, lightweight implementation of the Latent Dirichlet Allocation (LDA) algorithm, using a parallel vanilla Gibbs samp…
  ☆61Updated 9 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• bloomberg / luwak
  A java library for stored queries
  ☆16Updated last year
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆213Updated 2 years ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• o19s / lazy-semantic-indexing
  Elasticsearch Latent Semantic Indexing experimentation
  ☆33Updated 5 years ago
• utcompling / applied-nlp
  Course repository for Applied Natural Language Processing
  ☆124Updated 11 years ago
• Findwise / Hydra
  Distributed processing framework for search solutions
  ☆81Updated 2 years ago
• o19s / lucene-query-example
  Educational Examle of a custom Lucene Query & Scorer
  ☆48Updated 5 years ago