ept / warc-hadoopLinks
WARC (Web Archive) Input and Output Formats for Hadoop
☆37Updated 10 years ago
Alternatives and similar repositories for warc-hadoop
Users that are interested in warc-hadoop are comparing it to the libraries listed below
Sorting:
- The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning☆134Updated 4 years ago
- Puck is a lightning-fast parser for natural languages using GPUs☆248Updated 10 years ago
- Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets☆92Updated 9 years ago
- ☆41Updated 8 years ago
- Tutorial on parsing Enron email to Avro and then explore the email set using Spark.☆52Updated last year
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆149Updated 3 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆37Updated 9 months ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Chalk is a natural language processing library.☆260Updated 8 years ago
- Course repository for Applied Natural Language Processing☆125Updated 12 years ago
- Mirror of Apache Stanbol (incubating)☆114Updated last year
- Scalable Machine Learning in Scalding☆361Updated 7 years ago
- Educational Examle of a custom Lucene Query & Scorer☆48Updated 5 years ago
- Distributed DataFrame: Productivity = Power x Simplicity For Scientists & Engineers, on any Data Engine☆167Updated 4 years ago
- TinkerPop 3 implementation on Elasticsearch backend☆70Updated 9 years ago
- ☆110Updated 8 years ago
- How to spot first stories on Twitter using Storm.☆124Updated last year
- A CPU and GPU-accelerated matrix library for data mining☆266Updated 4 years ago
- Machine Learning for Cascading☆83Updated 10 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- ☆92Updated 9 years ago
- An example of running Apache Spark using Scala in ipython notebook☆140Updated 10 years ago
- The WikiBrain Java library enables researchers and developers to incorporate state-of-the-art Wikipedia-based algorithms and technologies…☆95Updated 7 years ago
- Docker image for apache zeppelin☆38Updated 8 years ago
- Distributed, streaming anomaly detection and prediction with HTM in Apache Flink☆136Updated 8 years ago
- An efficient and flexible token-based regular expression language and engine.☆75Updated 11 years ago
- This is my main Java library for all kinds of datastructures, algorithms and everything else that I need.☆73Updated 2 years ago