Alternatives and similar repositories for nutch:

Users that are interested in nutch are comparing it to the libraries listed below

• NAMD / pypln.backend
  Pipeline for distributed Natural Language Processing, made in Python
  ☆65Updated 8 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 4 years ago
• DiceTechJobs / VectorsInSearch
  Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…
  ☆85Updated 3 years ago
• xiaoganghan / wikientities
  Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts
  ☆59Updated 12 years ago
• idio / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby
  ☆17Updated 2 years ago
• uhh-lt / targer
  A web application tagging and retrieval of arguments in text
  ☆29Updated last year
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 7 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated 10 months ago
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆116Updated 3 weeks ago
• ixa-ehu / ixa-pipe-nerc
  IXA pipes Named Entity Tagger (http://ixa2.si.ehu.es/ixa-pipes).
  ☆32Updated 6 years ago
• dragnet-org / dragnet_data
  code and data used to build a training dataset for dragnet models
  ☆10Updated 4 years ago
• dbpedia-spotlight / wikipedia-stats-extractor
  Raw Wikipedia counts for entity linking
  ☆19Updated 7 years ago
• ikreymer / cc-index-server
  Deployment of pywb as a CommonCrawl Index Server
  ☆21Updated 7 years ago
• seomoz / dragnet_data
  Training/test data for Dragnet
  ☆41Updated 10 years ago
• semanticize / semanticizer
  Entity Linking for the masses
  ☆56Updated 9 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• opensemanticsearch / solr-ontology-tagger
  Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri
  ☆47Updated 3 years ago
• khundman / marve
  For extracting measurements and related entities from text
  ☆57Updated 4 years ago
• alephdata / synonames
  Trying to generate name synonyms from wikidata
  ☆32Updated 4 years ago
• h10r / topic_comparison_tool
  Using word2vec and t-SNE to compare text sources.
  ☆20Updated 9 years ago
• emorynlp / nlp4j-old
  NLP tools developed by Emory University.
  ☆60Updated 8 years ago
• nasa-jpl-memex / memex-gate
  General Architecture for Text Engineering
  ☆48Updated 9 years ago
• andychisholm / sift
  Knowledge extraction from web data
  ☆92Updated 6 years ago
• USCDataScience / NLTKRest
  This is a REST Server endpoint built using Flask and Python.
  ☆24Updated 2 years ago
• leondz / entity_recognition
  framework for doing NER and other types of entity recognition, in Python
  ☆68Updated 2 years ago
• dbpedia / lookup
  Outputs a list of ranked DBpedia resources for a search string.
  ☆186Updated 3 years ago
• jpbruinsslot / warc3
  Python 3 library for reading and writing warc files
  ☆20Updated 7 years ago
• jplu / ADEL
  ADEL is a robust and efficient entity linking framework that is adaptive to text genres and language, entity types for the classification…
  ☆19Updated 5 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 8 years ago