Alternatives and similar repositories for cc-warc-examples

Users that are interested in cc-warc-examples are comparing it to the libraries listed below

• iipc / webarchive-commons
  Common web archive utility code.
  ☆55Updated 2 weeks ago
• lintool / warcbase
  Warcbase is an open-source platform for managing analyzing web archives
  ☆162Updated 7 years ago
• apache / stanbol
  Mirror of Apache Stanbol (incubating)
  ☆112Updated last year
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• iipc / jwarc
  Java library for reading and writing WARC files with a typed API
  ☆49Updated 3 weeks ago
• diegoceccarelli / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json/avro dump
  ☆253Updated last year
• Wikidata / primarysources
  Approve or reject statements from third-party datasets
  ☆146Updated 7 years ago
• OpenSextant / SolrTextTagger
  A text tagger based on Lucene / Solr, using FST technology
  ☆176Updated last year
• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆282Updated 7 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆244Updated last week
• zelandiya / maui
  ☆184Updated 6 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆149Updated 3 years ago
• opencog / relex
  English Dependency Relationship Extractor
  ☆85Updated 7 months ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated this week
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• ukwa / webarchive-explorer
  Tools for exploring the contents of web archive files.
  ☆40Updated 4 years ago
• emorynlp / nlp4j-old
  NLP tools developed by Emory University.
  ☆60Updated 9 years ago
• commoncrawl / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆38Updated 7 months ago
• USCDataScience / SentimentAnalysisParser
  Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.
  ☆34Updated 2 years ago
• dstl / baleen
  Entity Extraction Text Processor
  ☆147Updated last year
• behas / lucene-skos
  SKOS Support for Apache Lucene and Solr
  ☆56Updated 4 years ago
• nasa-jpl-memex / memex-gate
  General Architecture for Text Engineering
  ☆50Updated 9 years ago
• sweble / sweble-wikitext
  The Sweble Wikitext Components module provides a parser for MediaWiki's wikitext and an engine trying to emulate the behavior of a MediaW…
  ☆73Updated last year
• fergiemcdowall / solrstrap
  Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS
  ☆87Updated 8 years ago
• helgeho / ArchiveSpark
  An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…
  ☆152Updated last week
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• semanticvectors / semanticvectors
  SemanticVectors creates semantic WordSpace models from free natural language text.
  ☆219Updated 2 years ago
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆217Updated 2 years ago
• rossf7 / elasticrawl
  Launch AWS Elastic MapReduce jobs that process Common Crawl data.
  ☆49Updated 8 years ago