ept / warc-hadoopLinks
WARC (Web Archive) Input and Output Formats for Hadoop
☆37Updated 11 years ago
Alternatives and similar repositories for warc-hadoop
Users that are interested in warc-hadoop are comparing it to the libraries listed below
Sorting:
- Educational Examle of a custom Lucene Query & Scorer☆48Updated 5 years ago
- The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning☆134Updated 4 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆223Updated 3 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets☆92Updated 10 years ago
- Puck is a lightning-fast parser for natural languages using GPUs☆250Updated 11 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- ☆41Updated 8 years ago
- Chalk is a natural language processing library.☆260Updated 8 years ago
- A CPU and GPU-accelerated matrix library for data mining☆267Updated 4 years ago
- Course repository for Applied Natural Language Processing☆125Updated 12 years ago
- Scala utilities for teaching computational linguistics and prototyping algorithms.☆42Updated 13 years ago
- ☆92Updated 10 years ago
- A new object-graph-wrapper for the Tinkerpop 3 graph stack.☆40Updated 4 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆26Updated 7 years ago
- NLP framework for JVM languages.☆154Updated 4 years ago
- Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark☆142Updated 3 weeks ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- Scalable Machine Learning in Scalding☆359Updated 7 years ago
- A language detection library for the JVM☆36Updated 2 years ago
- Machine learning components for Apache UIMA☆132Updated 2 years ago
- Using deep learning to POS tag sentences using scala + DL4J☆37Updated 10 years ago
- TinkerPop 3 implementation on Elasticsearch backend☆70Updated 10 years ago
- Use Cascading Taps and Scalding DSL with Spark☆49Updated 9 years ago
- Lucene Auto Phrase TokenFilter implementation☆59Updated 7 years ago
- An example of running Apache Spark using Scala in ipython notebook☆140Updated 10 years ago
- ReactiveLDA is a fast, lightweight implementation of the Latent Dirichlet Allocation (LDA) algorithm, using a parallel vanilla Gibbs samp…☆61Updated 10 years ago
- Big Data Science Swiss Army Knife - http://www.tuktu.io --☆60Updated 7 years ago
- NLP toolkit (tokenizer, POS-tagger, parser, etc.)☆43Updated 8 years ago