Alternatives and similar repositories for crawl-anywhere

Users that are interested in crawl-anywhere are comparing it to the libraries listed below

• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆216Updated 2 years ago
• BayanGroup / nutch-custom-search
  ☆66Updated 8 years ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• shirk3y / selectorgadget-plus
  A tool for manage website extraction configs
  ☆37Updated 11 years ago
• codelibs / elasticsearch-river-web
  Web Crawler for Elasticsearch
  ☆235Updated 5 years ago
• senseidb / sensei
  distributed realtime searchable database
  ☆117Updated 10 years ago
• lucidworks / solrlogmanager
  solr-logstash
  ☆43Updated 9 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• spinscale / elasticsearch-facetgrapher
  Small hack to draw date histogram facets as graph using nvd3.js
  ☆54Updated 12 years ago
• searchdaimon / enterprise-search
  An open source search engine for corporate data and websites.
  ☆106Updated 7 years ago
• lumongo / lumongo
  Distributed Realtime Search with Lucene and MongoDB
  ☆59Updated 7 years ago
• sonian / elasticsearch-jetty
  ☆284Updated 3 years ago
• elastic / elasticsearch-river-twitter
  Twitter River Plugin for elasticsearch (STOPPED)
  ☆204Updated 10 months ago
• endgameinc / elasticsearch-term-plugin
  Term List Matching Plugin for ElasticSearch
  ☆26Updated 11 years ago
• tpickett / mongo-elasticsearch-nutch
  Docker image for creating a single Apache Nutch server, with mongodb as crawl storage and Elasticsearch for indexing
  ☆17Updated 9 years ago
• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆188Updated this week
• insidersolutions / weka-mnb-sentiment-analysis-template-project
  The template project for three way and five way sentiment classification
  ☆11Updated 8 years ago
• lucidworks / query-autofiltering-component
  A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata
  ☆28Updated 6 years ago
• superfeedr / feediscovery
  Feed discovery to share :)
  ☆41Updated 8 years ago
• hollingsworthd / ScreenSlicer
  Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JS…
  ☆155Updated 7 years ago
• samekmichal / elasticsearch-analysis-annotation
  Analysis plugin for ElasticSearch providing capability for processing inline annotations in documents.
  ☆35Updated 11 years ago
• jprante / elasticsearch-skywalker
  Skywalker for Elasticsearch is like Luke for Lucene
  ☆79Updated 5 years ago
• sematext / query-segmenter
  Solr Query Segmenter for structuring unstructured queries
  ☆22Updated 4 years ago
• svola / ElasticUI-extension
  An extension to the demo template of ElasticUI a beautiful AngularJS frontend to ElasticSearch for faceted navigation
  ☆39Updated 9 years ago
• jprante / elasticsearch-langdetect
  A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector
  ☆252Updated 7 years ago
• domainersuitedev / delicious-api
  Delicious API Documentation
  ☆278Updated 10 years ago
• andrewvc / elastic-hammer
  Rich browser-based frontend for elasticsearch
  ☆102Updated 10 years ago
• fergiemcdowall / solrstrap
  Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS
  ☆87Updated 8 years ago
• dbpedia / dbpedia-live-mirror
  Keeps a mirror of DBpedia live in sync
  ☆26Updated 3 years ago
• mvogiatzis / first-stories-twitter
  How to spot first stories on Twitter using Storm.
  ☆125Updated last year