Alternatives and similar repositories for incubator-stormcrawler:

Users that are interested in incubator-stormcrawler are comparing it to the libraries listed below

• USCDataScience / sparkler
  Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  ☆415Updated 2 years ago
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,309Updated 2 months ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆243Updated 3 weeks ago
• istresearch / scrapy-cluster
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,203Updated last year
• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,003Updated 3 weeks ago
• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆188Updated this week
• carrot2 / elasticsearch-carrot2
  Carrot2 plugin for ElasticSearch
  ☆291Updated 2 years ago
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,114Updated 7 years ago
• VIDA-NYU / ache
  ACHE is a web crawler for domain-specific search.
  ☆468Updated last year
• ziyan / spider
  Web Content Extraction Through Machine Learning
  ☆185Updated 11 years ago
• apache / opennlp
  Apache OpenNLP
  ☆1,507Updated this week
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆213Updated 2 years ago
• Smerity / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆56Updated 3 years ago
• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆328Updated 2 years ago
• lucidworks / spark-solr
  Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
  ☆446Updated last year
• OpenSextant / SolrTextTagger
  A text tagger based on Lucene / Solr, using FST technology
  ☆176Updated last year
• healthonnet / hon-lucene-synonyms
  Solr query parser plugin that performs proper query-time synonym expansion.
  ☆150Updated 3 years ago
• spinscale / elasticsearch-ingest-opennlp
  An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP
  ☆271Updated 2 years ago
• linkedin / URL-Detector
  A Java library to detect and normalize URLs in text
  ☆782Updated 2 years ago
• jaeksoft / opensearchserver
  Open-source Enterprise Grade Search Engine Software
  ☆505Updated 2 years ago
• codelibs / elasticsearch-taste
  Mahout Taste-based recommendation on Elasticsearch
  ☆335Updated 5 years ago
• karussell / snacktory
  Readability clone in Java
  ☆459Updated 4 years ago
• flaxsearch / luwak
  A java library for stored queries
  ☆375Updated 2 years ago
• elastic / elasticsearch-hadoop
  Elasticsearch real-time search and analytics natively integrated with Hadoop
  ☆1,937Updated last week
• jprante / elasticsearch-langdetect
  A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector
  ☆252Updated 7 years ago
• divolte / divolte-collector
  Divolte Collector
  ☆281Updated 3 years ago
• scrapinghub / scrapyrt
  HTTP API for Scrapy spiders
  ☆855Updated 9 months ago
• lucidworks / banana
  Banana for Solr - A Port of Kibana
  ☆670Updated 8 months ago
• querqy / querqy
  Query preprocessor for Java-based search engines (Querqy Core and Solr implementation)
  ☆184Updated last week
• mikemccand / luceneserver
  A high performance "thin wrapper" HTTP REST server on top of Apache Lucene
  ☆143Updated 11 months ago