commoncrawl / cc-warc-examplesLinks
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆37Updated 9 months ago
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
Sorting:
- WARC (Web Archive) Input and Output Formats for Hadoop☆37Updated 10 years ago
- Angular JS Solr and Elasticsearch and OpenSearch Diagnostic Search Services☆27Updated 2 months ago
- A set of reusable Java components that implement functionality common to any web crawler☆248Updated last week
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- Search a single field with different query time analyzers in Solr☆25Updated 5 years ago
- Fusion demo app searching open-source project data from the Apache Software Foundation☆43Updated 6 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- A text tagger based on Lucene / Solr, using FST technology☆177Updated last year
- The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning☆134Updated 4 years ago
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 10 years ago
- Extract statistics from Wikipedia Dump files.☆26Updated 4 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆27Updated 6 years ago
- Extensions for and tools to work with CoreNlp☆24Updated 3 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆149Updated 3 years ago
- Simple search results with Solr and EmberJS☆58Updated 6 years ago
- TheMovieDB in Solr☆22Updated last year
- A single docker image that combines Neo4j Mazerunner and Apache Spark GraphX into a powerful all-in-one graph processing engine☆46Updated 6 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆57Updated 4 years ago
- Blazegraph Tinkerpop3 Implementation☆62Updated 4 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Sentiment analysis framework developed by CERTH.☆22Updated 10 years ago
- Mirror of Apache Stanbol (incubating)☆114Updated last year
- ☆18Updated 9 years ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆65Updated 9 years ago
- The first Open Source document analysis platform☆65Updated 4 years ago
- The Sweble Wikitext Components module provides a parser for MediaWiki's wikitext and an engine trying to emulate the behavior of a MediaW…☆73Updated last year
- Raw Wikipedia counts for entity linking☆19Updated 8 years ago
- Lucene Auto Phrase TokenFilter implementation☆59Updated 7 years ago