Alternatives and similar repositories for cc-warc-examples

Users that are interested in cc-warc-examples are comparing it to the libraries listed below

• iipc / webarchive-commons
  Common web archive utility code.
  ☆59Updated 3 weeks ago
• apache / stanbol
  Mirror of Apache Stanbol (incubating)
  ☆115Updated last year
• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆283Updated 7 years ago
• lintool / warcbase
  Warcbase is an open-source platform for managing analyzing web archives
  ☆162Updated 8 years ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• diegoceccarelli / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json/avro dump
  ☆255Updated 2 years ago
• Wikidata / primarysources
  Approve or reject statements from third-party datasets
  ☆146Updated 7 years ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆149Updated 4 years ago
• OpenSextant / SolrTextTagger
  A text tagger based on Lucene / Solr, using FST technology
  ☆177Updated 2 years ago
• behas / lucene-skos
  SKOS Support for Apache Lucene and Solr
  ☆56Updated 4 years ago
• DiceTechJobs / SolrPlugins
  Dice Solr Plugins from Simon Hughes Dice.com
  ☆88Updated 4 years ago
• USCDataScience / SentimentAnalysisParser
  Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.
  ☆34Updated 2 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆251Updated this week
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆64Updated 5 months ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆47Updated 8 years ago
• dstl / baleen
  Entity Extraction Text Processor
  ☆149Updated 2 years ago
• tamingtext / book
  Taming Text Book Source Code
  ☆383Updated 2 years ago
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆223Updated 3 years ago
• opencog / relex
  English Dependency Relationship Extractor
  ☆87Updated this week
• ept / warc-hadoop
  WARC (Web Archive) Input and Output Formats for Hadoop
  ☆37Updated 11 years ago
• fergiemcdowall / solrstrap
  Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS
  ☆87Updated 8 years ago
• commoncrawl / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆37Updated last year
• helgeho / ArchiveSpark
  An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…
  ☆156Updated 3 months ago
• semanticvectors / semanticvectors
  SemanticVectors creates semantic WordSpace models from free natural language text.
  ☆221Updated 3 years ago
• o19s / Spyglass
  Simple search results with Solr and EmberJS
  ☆58Updated 6 years ago
• o19s / match-query-parser
  Search a single field with different query time analyzers in Solr
  ☆25Updated 5 years ago
• ziqizhang / jate
  NEWS: JATE2.0 Beta.11 Released, see details below.
  ☆84Updated 2 years ago
• commoncrawl / nutch
  Common Crawl fork of Apache Nutch
  ☆40Updated 2 weeks ago
• dswarm / dswarm
  an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)
  ☆54Updated 8 years ago