ept / warc-hadoopLinks
WARC (Web Archive) Input and Output Formats for Hadoop
☆35Updated 10 years ago
Alternatives and similar repositories for warc-hadoop
Users that are interested in warc-hadoop are comparing it to the libraries listed below
Sorting:
- A toolkit that wraps various natural language processing implementations behind a common interface.☆101Updated 7 years ago
- Course repository for Applied Natural Language Processing☆126Updated 12 years ago
- Puck is a lightning-fast parser for natural languages using GPUs☆250Updated 10 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆216Updated 2 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- ☆41Updated 7 years ago
- Scala utilities for teaching computational linguistics and prototyping algorithms.☆42Updated 12 years ago
- ReactiveLDA is a fast, lightweight implementation of the Latent Dirichlet Allocation (LDA) algorithm, using a parallel vanilla Gibbs samp…☆61Updated 9 years ago
- An efficient and flexible token-based regular expression language and engine.☆75Updated 11 years ago
- A Scala wrapper for CoreNLP☆40Updated 9 years ago
- Educational Examle of a custom Lucene Query & Scorer☆48Updated 5 years ago
- NLP toolkit (tokenizer, POS-tagger, parser, etc.)☆42Updated 8 years ago
- Using deep learning to POS tag sentences using scala + DL4J☆37Updated 10 years ago
- Algorithms that build k-nearest neighbors graph (k-nn graph): Brute-force, NN-Descent,...☆34Updated 6 years ago
- Chalk is a natural language processing library.☆259Updated 8 years ago
- ☆92Updated 9 years ago
- Graph Processing Algorithms on top of Neo4j☆39Updated 7 years ago
- Apache Joshua☆107Updated 4 years ago
- The Sweble Wikitext Components module provides a parser for MediaWiki's wikitext and an engine trying to emulate the behavior of a MediaW…☆72Updated last year
- Machine Learning for Cascading☆82Updated 9 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- NLP tools developed by Emory University.☆60Updated 8 years ago
- Use Cascading Taps and Scalding DSL with Spark☆49Updated 8 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆38Updated 5 months ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆149Updated 3 years ago
- An Apache Spark-shell backend for IPython☆105Updated 3 years ago
- Juicer is a web API for extracting text, meta data and named entities from HTML "article" type pages.☆59Updated 9 years ago
- Templates for projects based on top of H2O.☆38Updated 2 months ago