Alternatives and similar repositories for crawl-anywhere

Users that are interested in crawl-anywhere are comparing it to the libraries listed below

• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• BayanGroup / nutch-custom-search
  ☆66Updated 8 years ago
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆222Updated 2 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• hollingsworthd / ScreenSlicer
  Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JS…
  ☆155Updated 8 years ago
• jiminoc / goose
  Html Content / Article Extractor in Scala - open sourced from Gravity Labs - http://gravity.com
  ☆343Updated 6 years ago
• polyfractal / ElasticBayes
  Naive Bayes Classifier implemented with Elasticsearch Aggregations
  ☆51Updated 11 years ago
• codelibs / elasticsearch-river-web
  Web Crawler for Elasticsearch
  ☆234Updated 5 years ago
• seagatesoft / sde
  Structured Data Extractor. An application to extract structured data from web pages. It uses Data Extraction Based on Partial Tree Alignm…
  ☆49Updated 13 years ago
• searchdaimon / enterprise-search
  An open source search engine for corporate data and websites.
  ☆107Updated 8 years ago
• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆194Updated 3 weeks ago
• maxdemarzi / neo_graph_search
  A POC at replicating Facebook Graph Search with Cypher and Neo4j
  ☆101Updated 12 years ago
• jprante / elasticsearch-langdetect
  A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector
  ☆252Updated 7 years ago
• OlivierBlanvillain / crawler
  Blog crawler for the blogforever project.
  ☆23Updated 11 years ago
• CottageLabs / facetview2
  a pure javascript frontend for ElasticSearch search indices.
  ☆80Updated 7 years ago
• fergiemcdowall / solrstrap
  Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS
  ☆87Updated 8 years ago
• lucidworks / solrlogmanager
  solr-logstash
  ☆43Updated 9 years ago
• carrot2 / elasticsearch-carrot2
  Carrot2 plugin for ElasticSearch
  ☆291Updated 2 years ago
• rufuspollock-okfn / elasticsearch.js
  A simple javascript library for working with ElasticSearch
  ☆78Updated 9 years ago
• zzzprojects / sqlfiddle2
  New version of SQL Fiddle based on OpenIDM
  ☆198Updated last year
• YannBrrd / elasticsearch-entity-resolution
  Elasticsearch entity resolution plugin based on Duke
  ☆209Updated 5 years ago
• SocialHarvest / dashboard
  A modular dashboard that visualizes data gathered by Social Harvest server (as well as from other sources).
  ☆36Updated 9 years ago
• Smerity / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆57Updated 4 years ago
• cheics / sense
  a json aware ElasticSearch front end
  ☆48Updated 11 years ago
• commoncrawl / commoncrawl-examples
  A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)
  ☆65Updated 9 years ago
• openpreserve / pagelyzer
  Suite of tools for detecting changes in web pages and their rendering
  ☆55Updated last year
• rufuspollock-okfn / facetview
  FacetView is a pure javascript frontend for ElasticSearch.
  ☆291Updated 10 years ago
• mvogiatzis / first-stories-twitter
  How to spot first stories on Twitter using Storm.
  ☆124Updated last year
• superfeedr / feediscovery
  Feed discovery to share :)
  ☆41Updated 8 years ago
• svola / ElasticUI-extension
  An extension to the demo template of ElasticUI a beautiful AngularJS frontend to ElasticSearch for faceted navigation
  ☆39Updated 10 years ago