ept / warc-hadoopLinks
WARC (Web Archive) Input and Output Formats for Hadoop
☆37Updated 10 years ago
Alternatives and similar repositories for warc-hadoop
Users that are interested in warc-hadoop are comparing it to the libraries listed below
Sorting:
- Educational Examle of a custom Lucene Query & Scorer☆48Updated 5 years ago
- Fusion demo app searching open-source project data from the Apache Software Foundation☆43Updated 7 years ago
- The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning☆134Updated 4 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- An example of running Apache Spark using Scala in ipython notebook☆140Updated 10 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆37Updated 10 months ago
- TinkerPop 3 implementation on Elasticsearch backend☆70Updated 10 years ago
- Puck is a lightning-fast parser for natural languages using GPUs☆248Updated 11 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆222Updated 2 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- ☆41Updated 8 years ago
- Chalk is a natural language processing library.☆260Updated 8 years ago
- Big Data Science Swiss Army Knife - http://www.tuktu.io --☆60Updated 7 years ago
- Scalable Machine Learning in Scalding☆360Updated 7 years ago
- A new object-graph-wrapper for the Tinkerpop 3 graph stack.☆40Updated 4 years ago
- Tutorial on parsing Enron email to Avro and then explore the email set using Spark.☆52Updated last year
- Course repository for Applied Natural Language Processing☆125Updated 12 years ago
- A CPU and GPU-accelerated matrix library for data mining☆265Updated 4 years ago
- Lucene Auto Phrase TokenFilter implementation☆59Updated 7 years ago
- Using deep learning to POS tag sentences using scala + DL4J☆37Updated 10 years ago
- Experiments with the GDELT dataset and Cassandra schemas.☆25Updated 9 years ago
- Simple Spark app that reads and writes Avro data☆31Updated 10 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 3 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- ☆92Updated 9 years ago
- Scala utilities for teaching computational linguistics and prototyping algorithms.☆42Updated 12 years ago
- Machine Learning for Cascading☆83Updated 10 years ago
- Apache OpenNLP Sandbox☆44Updated last week
- Use Cascading Taps and Scalding DSL with Spark☆49Updated 8 years ago
- The Sweble Wikitext Components module provides a parser for MediaWiki's wikitext and an engine trying to emulate the behavior of a MediaW…☆73Updated last year