Smerity / cc-warc-examplesLinks
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆56Updated 4 years ago
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
Sorting:
- Common web archive utility code.☆57Updated this week
- Mirror of Apache Stanbol (incubating)☆114Updated last year
- Warcbase is an open-source platform for managing analyzing web archives☆161Updated 8 years ago
- A text tagger based on Lucene / Solr, using FST technology☆177Updated last year
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- SKOS Support for Apache Lucene and Solr☆56Updated 4 years ago
- Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS☆87Updated 8 years ago
- an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)☆54Updated 7 years ago
- ☆185Updated 7 years ago
- Approve or reject statements from third-party datasets☆146Updated 7 years ago
- Named-Entity Recognition extension for Google Refine / OpenRefine☆73Updated 8 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- SKOS analysis for Elasticsearch☆54Updated 9 years ago
- Entity Extraction Text Processor☆148Updated 2 years ago
- An open source toolkit for mining Wikipedia☆128Updated 7 years ago
- SIREn - Semi-Structured Information Retrieval Engine☆108Updated 4 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 4 years ago
- Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri☆47Updated 3 years ago
- Solr query parser plugin that performs proper query-time synonym expansion.☆149Updated 4 years ago
- English Dependency Relationship Extractor☆86Updated last month
- An RDF plugin for Solr☆114Updated 10 months ago
- SemanticVectors creates semantic WordSpace models from free natural language text.☆220Updated 3 years ago
- Scripts and microservice to feed an ElasticSearch with Wikidata and Inventaire entities, and keep those up-to-date☆41Updated 4 years ago
- Collection of software components for natural language processing (NLP) based on the Apache UIMA framework.☆199Updated 4 months ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…☆154Updated last month
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 8 years ago
- Json Wikipedia, contains code to convert the Wikipedia xml dump into a json/avro dump☆254Updated 2 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago