Alternatives and similar repositories for nutch

Users that are interested in nutch are comparing it to the libraries listed below

• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 5 years ago
• diffbot / wikistatsextractor
  Extract statistics from Wikipedia Dump files.
  ☆26Updated 3 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• xiaoganghan / wikientities
  Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts
  ☆59Updated 12 years ago
• jpbruinsslot / warc3
  Python 3 library for reading and writing warc files
  ☆20Updated 7 years ago
• seomoz / simhash-db-py
  Python API for Various DB-Backed Simhash Clusters
  ☆64Updated 8 years ago
• dbpedia-spotlight / wikipedia-stats-extractor
  Raw Wikipedia counts for entity linking
  ☆19Updated 8 years ago
• ixa-ehu / ixa-pipe-nerc
  IXA pipes Named Entity Tagger (http://ixa2.si.ehu.es/ixa-pipes).
  ☆32Updated 6 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 8 years ago
• idio / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby
  ☆17Updated 3 years ago
• opensemanticsearch / solr-ontology-tagger
  Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri
  ☆47Updated 3 years ago
• andychisholm / sift
  Knowledge extraction from web data
  ☆92Updated 7 years ago
• mitll / topic-clustering
  ☆43Updated 9 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• iipc / webarchive-commons
  Common web archive utility code.
  ☆55Updated last month
• NAMD / pypln.backend
  Pipeline for distributed Natural Language Processing, made in Python
  ☆65Updated 8 years ago
• kermitt2 / grobid-ner
  A Named-Entity Recogniser based on Grobid.
  ☆53Updated last month
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆122Updated last month
• dbpedia / topicmodel-extractor
  A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea
  ☆13Updated 8 years ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• GregBowyer / cld2-cffi
  Python bindings to the Compact Language Detector
  ☆33Updated 5 years ago
• nasa-jpl-memex / memex-gate
  General Architecture for Text Engineering
  ☆50Updated 9 years ago
• wikimedia / editquality
  Github mirror - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_access for contributing)
  ☆36Updated last year
• AKSW / SemWeb2NL
  Semantic Web related concepts converted to Natural language
  ☆44Updated 7 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• semanticize / semanticizer
  Entity Linking for the masses
  ☆56Updated 9 years ago
• google-research-datasets / wiki-links
  Automatically exported from code.google.com/p/wiki-links
  ☆42Updated 9 years ago
• o19s / lazy-semantic-indexing
  Elasticsearch Latent Semantic Indexing experimentation
  ☆33Updated 5 years ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆191Updated 3 years ago
• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆194Updated 7 years ago