Alternatives and similar repositories for mongo-elasticsearch-nutch

Users that are interested in mongo-elasticsearch-nutch are comparing it to the libraries listed below

• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• bejean / crawl-anywhere
  Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
  ☆98Updated 8 years ago
• Webhose / article-date-extractor
  Automatically extracts and normalizes an online article or blog post publication date
  ☆117Updated 2 years ago
• romansanchez / Calaca
  Search UI for Elasticsearch
  ☆325Updated 4 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆205Updated 7 years ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• jgontrum / spacy-api-docker
  spaCy REST API, wrapped in a Docker container.
  ☆267Updated 2 years ago
• psolbach / mehrwert
  Aviation grade news article metadata extraction
  ☆36Updated 2 years ago
• JeroenDeDauw / JsonDumpReader
  📖 Library that provides ways to read from and iterate through the Wikibase entities in a Wikibase Repository JSON dump
  ☆72Updated last year
• ziyan / spider
  Web Content Extraction Through Machine Learning
  ☆185Updated 11 years ago
• mrjleo / boilernet
  Boilerplate Removal using Deep Learning
  ☆83Updated 3 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆342Updated 3 months ago
• LogicalSpark / docker-tikaserver
  Apache Tika Server as a Docker Image
  ☆173Updated 3 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• jprante / elasticsearch-langdetect
  A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector
  ☆251Updated 8 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 6 years ago
• artpar / languagecrunch
  LanguageCrunch NLP server docker image
  ☆285Updated 3 years ago
• VIDA-NYU / ache
  ACHE is a web crawler for domain-specific search.
  ☆475Updated 3 months ago
• NAMD / pypln.backend
  Pipeline for distributed Natural Language Processing, made in Python
  ☆65Updated 8 years ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆86Updated 9 years ago
• ipeirotis / ReadabilityMetrics
  A web service that computes a set of readability metrics for text. We currently support the following metrics: Automated Readability Inde…
  ☆72Updated 3 years ago
• jjangsangy / ExplainToMe
  Automatic Web Article Summarizer
  ☆416Updated 4 years ago
• explosion / spacy-services
  💫 REST microservices for various spaCy-related tasks
  ☆241Updated 3 years ago
• commoncrawl / cc-mrjob
  Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
  ☆168Updated 3 years ago
• TeamHG-Memex / deep-deep
  Adaptive crawler which uses Reinforcement Learning methods
  ☆168Updated last week
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆191Updated 3 years ago
• dalab / web2text
  Source code for the paper "Web2Text: Deep Structured Boilerplate Removal", full paper @ ECIR'18
  ☆170Updated 4 years ago
• rodricios / eatiht
  An exercise in unsupervised machine learning: Extract Article's Text in HTml documents.
  ☆432Updated last year
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆126Updated 6 years ago
• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆197Updated 8 years ago