Alternatives and similar repositories for warc-hadoop

Users that are interested in warc-hadoop are comparing it to the libraries listed below

• dlwh / puck
  Puck is a lightning-fast parser for natural languages using GPUs
  ☆249Updated 11 years ago
• o19s / lucene-query-example
  Educational Examle of a custom Lucene Query & Scorer
  ☆48Updated 5 years ago
• scalanlp / chalk
  Chalk is a natural language processing library.
  ☆260Updated 8 years ago
• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆283Updated 7 years ago
• algorithmfoundry / Foundry
  The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning
  ☆134Updated 4 years ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• etsy / Conjecture
  Scalable Machine Learning in Scalding
  ☆360Updated 7 years ago
• deepsense-ai / seahorse-workflow-executor
  ☆41Updated 8 years ago
• utcompling / Scalabha
  Scala utilities for teaching computational linguistics and prototyping algorithms.
  ☆42Updated 12 years ago
• bayofmany / peapod
  A new object-graph-wrapper for the Tinkerpop 3 graph stack.
  ☆40Updated 4 years ago
• Sotera / correlation-approximation
  Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets
  ☆92Updated 9 years ago
• lucidworks / searchhub
  Fusion demo app searching open-source project data from the Apache Software Foundation
  ☆43Updated 7 years ago
• sjyk / sampleclean-async
  ☆92Updated 10 years ago
• hohonuuli / sparknotebook
  An example of running Apache Spark using Scala in ipython notebook
  ☆140Updated 10 years ago
• Cascading / pattern
  Machine Learning for Cascading
  ☆83Updated 10 years ago
• commoncrawl / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆37Updated 11 months ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆148Updated 4 years ago
• tribbloid / spookystuff
  Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark
  ☆142Updated this week
• knowitall / nlptools
  A toolkit that wraps various natural language processing implementations behind a common interface.
  ☆101Updated 8 years ago
• BIDData / BIDMat
  A CPU and GPU-accelerated matrix library for data mining
  ☆267Updated 4 years ago
• utcompling / applied-nlp
  Course repository for Applied Natural Language Processing
  ☆125Updated 12 years ago
• gangeli / CoreNLP-Scala
  A Scala wrapper for CoreNLP
  ☆40Updated 10 years ago
• tmbo / deep-nlp-scala
  Using deep learning to POS tag sentences using scala + DL4J
  ☆37Updated 10 years ago
• amplab / velox-modelserver
  ☆110Updated 8 years ago
• knowitall / openregex
  An efficient and flexible token-based regular expression language and engine.
  ☆75Updated 11 years ago
• amplab / ml-matrix
  Distributed Matrix Library
  ☆72Updated 8 years ago
• ClearTK / cleartk
  Machine learning components for Apache UIMA
  ☆132Updated 2 years ago
• ddf-project / DDF
  Distributed DataFrame: Productivity = Power x Simplicity For Scientists & Engineers, on any Data Engine
  ☆167Updated 4 years ago
• allenai / nlpstack
  NLP toolkit (tokenizer, POS-tagger, parser, etc.)
  ☆43Updated 8 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 7 years ago