Alternatives and similar repositories for incubator-stormcrawler:

Users that are interested in incubator-stormcrawler are comparing it to the libraries listed below

• USCDataScience / sparkler
  Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  ☆412Updated last year
• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆2,971Updated last month
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆213Updated 2 years ago
• lucidworks / banana
  Banana for Solr - A Port of Kibana
  ☆669Updated 6 months ago
• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆186Updated this week
• spinscale / elasticsearch-ingest-opennlp
  An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP
  ☆270Updated 2 years ago
• OpenSextant / SolrTextTagger
  A text tagger based on Lucene / Solr, using FST technology
  ☆176Updated last year
• eBay / restcommander
  Fast Parallel Async HTTP client as a Service to monitor and manage 10,000 web servers. (Java+Akka)
  ☆898Updated 7 years ago
• apache / gora
  The Apache Gora open source framework provides an in-memory data model and persistence for big data.
  ☆121Updated 11 months ago
• flaxsearch / luwak
  A java library for stored queries
  ☆375Updated last year
• apache / opennlp
  Apache OpenNLP
  ☆1,471Updated last week
• jiminoc / goose
  Html Content / Article Extractor in Scala - open sourced from Gravity Labs - http://gravity.com
  ☆343Updated 5 years ago
• lucidworks / spark-solr
  Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
  ☆446Updated last year
• carrot2 / elasticsearch-carrot2
  Carrot2 plugin for ElasticSearch
  ☆292Updated 2 years ago
• mhausenblas / lambda-architecture.net
  A repository of information, examples and good practices around the Lambda Architecture
  ☆368Updated 7 years ago
• querqy / querqy
  Query preprocessor for Java-based search engines (Querqy Core and Solr implementation)
  ☆183Updated this week
• apache / samza
  Mirror of Apache Samza
  ☆821Updated 2 months ago
• Netflix / suro
  Netflix's distributed Data Pipeline
  ☆795Updated last year
• apache / geode
  Apache Geode
  ☆2,299Updated last month
• LAW-Unimi / BUbiNG
  The LAW next generation crawler.
  ☆87Updated 3 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated 9 months ago
• carrot2 / carrot2
  Carrot2: Text Clustering Algorithms and Applications
  ☆793Updated 4 months ago
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆2,757Updated this week
• misja / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆543Updated 3 years ago
• divolte / divolte-collector
  Divolte Collector
  ☆281Updated 3 years ago
• kzwang / elasticsearch-image
  Content Based Image Retrieval Plugin for Elasticsearch. It allows users to index images and search for similar images.
  ☆408Updated 8 years ago
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,114Updated 7 years ago
• mesos / chronos
  Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules
  ☆4,386Updated 2 years ago
• rayokota / hgraphdb
  HBase as a TinkerPop Graph Database
  ☆256Updated this week
• MLnick / elasticsearch-vector-scoring
  Score documents with pure dot product / cosine similarity with ES
  ☆250Updated 3 years ago