commoncrawl / cc-warc-examplesLinks
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆37Updated 10 months ago
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
Sorting:
- Fusion demo app searching open-source project data from the Apache Software Foundation☆43Updated 7 years ago
- Angular JS Solr and Elasticsearch and OpenSearch Diagnostic Search Services☆27Updated 2 months ago
- Simple search results with Solr and EmberJS☆58Updated 6 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆57Updated 4 years ago
- Common web archive utility code.☆56Updated 2 months ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆246Updated 3 weeks ago
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 10 years ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆37Updated 10 years ago
- Graph Analytics Engine☆260Updated 11 years ago
- Blazegraph Tinkerpop3 Implementation☆62Updated 5 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆65Updated 9 years ago
- A single docker image that combines Neo4j Mazerunner and Apache Spark GraphX into a powerful all-in-one graph processing engine☆45Updated 6 years ago
- English Dependency Relationship Extractor☆85Updated 10 months ago
- TheMovieDB in Solr☆22Updated last year
- Json Wikipedia, contains code to convert the Wikipedia xml dump into a json/avro dump☆254Updated last year
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- Collects multimedia content shared through social networks.☆19Updated 10 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆221Updated 2 years ago
- A text tagger based on Lucene / Solr, using FST technology☆177Updated last year
- The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning☆134Updated 4 years ago
- Sentiment analysis framework developed by CERTH.☆22Updated 10 years ago
- Graph Processing Algorithms on top of Neo4j☆39Updated 8 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆27Updated 7 years ago
- NLP framework for JVM languages.☆152Updated 4 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Text similarity based on Word2Vec vectors.☆10Updated 8 years ago
- Search a single field with different query time analyzers in Solr☆25Updated 5 years ago
- Text Mining Library with a focus on Latent Semantic Analysis☆12Updated 12 years ago