Alternatives and similar repositories for stormcrawler

Users that are interested in stormcrawler are comparing it to the libraries listed below

• USCDataScience / sparkler
  Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  ☆416Updated 2 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆244Updated last week
• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆191Updated this week
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,117Updated 7 years ago
• lucidworks / banana
  Banana for Solr - A Port of Kibana
  ☆671Updated 11 months ago
• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆326Updated 3 years ago
• carrot2 / carrot2
  Carrot2: Text Clustering Algorithms and Applications
  ☆814Updated last week
• dragnet-org / dragnet
  Just the facts -- web page content extraction
  ☆1,268Updated last week
• VIDA-NYU / ache
  ACHE is a web crawler for domain-specific search.
  ☆469Updated last year
• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,043Updated this week
• optimaize / language-detector
  Language Detection Library for Java
  ☆581Updated 2 years ago
• crawljax / crawljax
  Crawljax
  ☆526Updated last year
• querqy / querqy
  Query preprocessor for Java-based search engines (Querqy Core and Solr implementation)
  ☆184Updated last month
• spinscale / elasticsearch-ingest-opennlp
  An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP
  ☆272Updated 2 years ago
• carrot2 / elasticsearch-carrot2
  Carrot2 plugin for ElasticSearch
  ☆291Updated 2 years ago
• strapdata / elassandra
  Elassandra = Elasticsearch + Apache Cassandra
  ☆1,719Updated last month
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆216Updated 2 years ago
• jiminoc / goose
  Html Content / Article Extractor in Scala - open sourced from Gravity Labs - http://gravity.com
  ☆343Updated 5 years ago
• flaxsearch / luwak
  A java library for stored queries
  ☆376Updated 2 years ago
• jprante / elasticsearch-langdetect
  A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector
  ☆252Updated 7 years ago
• DiceTechJobs / SolrPlugins
  Dice Solr Plugins from Simon Hughes Dice.com
  ☆87Updated 4 years ago
• divolte / divolte-collector
  Divolte Collector
  ☆281Updated 3 years ago
• elastic / elasticsearch-mapper-attachments
  Mapper Attachments Type plugin for Elasticsearch
  ☆503Updated 2 years ago
• LAW-Unimi / BUbiNG
  The LAW next generation crawler.
  ☆87Updated 3 years ago
• lucidworks / spark-solr
  Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
  ☆446Updated last year
• Netflix / suro
  Netflix's distributed Data Pipeline
  ☆797Updated 2 years ago
• healthonnet / hon-lucene-synonyms
  Solr query parser plugin that performs proper query-time synonym expansion.
  ☆150Updated 4 years ago
• codelibs / elasticsearch-taste
  Mahout Taste-based recommendation on Elasticsearch
  ☆335Updated 5 years ago
• o19s / splainer
  Elasticsearch/Solr Sandbox for exploring explain information and tweaking
  ☆137Updated last year
• larsga / Duke
  Duke is a fast and flexible deduplication engine written in Java
  ☆623Updated last year