Alternatives and similar repositories for cc-warc-examples:

Users that are interested in cc-warc-examples are comparing it to the libraries listed below

• apache / stanbol
  Mirror of Apache Stanbol (incubating)
  ☆112Updated last year
• iipc / webarchive-commons
  Common web archive utility code.
  ☆55Updated 3 weeks ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆281Updated 6 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆148Updated 3 years ago
• o19s / lazy-semantic-indexing
  Elasticsearch Latent Semantic Indexing experimentation
  ☆33Updated 5 years ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 8 years ago
• rdelbru / SIREn
  SIREn - Semi-Structured Information Retrieval Engine
  ☆107Updated 3 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 4 years ago
• behas / lucene-skos
  SKOS Support for Apache Lucene and Solr
  ☆56Updated 3 years ago
• OpenSextant / SolrTextTagger
  A text tagger based on Lucene / Solr, using FST technology
  ☆176Updated last year
• o19s / match-query-parser
  Search a single field with different query time analyzers in Solr
  ☆25Updated 5 years ago
• commoncrawl / example-warc-java
  ☆49Updated 8 years ago
• sematext / query-segmenter
  Solr Query Segmenter for structuring unstructured queries
  ☆21Updated 3 years ago
• ept / warc-hadoop
  WARC (Web Archive) Input and Output Formats for Hadoop
  ☆35Updated 10 years ago
• knowitall / nlptools
  A toolkit that wraps various natural language processing implementations behind a common interface.
  ☆101Updated 7 years ago
• lintool / warcbase
  Warcbase is an open-source platform for managing analyzing web archives
  ☆162Updated 7 years ago
• emorynlp / nlp4j-old
  NLP tools developed by Emory University.
  ☆60Updated 8 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• iipc / jwarc
  Java library for reading and writing WARC files with a typed API
  ☆48Updated 3 months ago
• commoncrawl / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆38Updated 3 months ago
• dswarm / dswarm
  an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)
  ☆54Updated 7 years ago
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆213Updated 2 years ago
• clir / clearnlp
  Software and resources for natural language processing.
  ☆131Updated 8 years ago
• dkuppitz / sparql-gremlin
  ☆71Updated 7 years ago
• dbpedia / dbpedia
  Various tools for the DBpedia project - This does NOT contain the DBpedia extaction framework
  ☆101Updated 11 months ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆44Updated 7 years ago
• rossf7 / elasticrawl
  Launch AWS Elastic MapReduce jobs that process Common Crawl data.
  ☆49Updated 8 years ago
• diffbot / wikistatsextractor
  Extract statistics from Wikipedia Dump files.
  ☆26Updated 3 years ago
• andreybratus / RefineOnSpark
  ☆33Updated 10 years ago