Alternatives and similar repositories for stormcrawler

Users that are interested in stormcrawler are comparing it to the libraries listed below

• USCDataScience / sparkler
  Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  ☆417Updated 2 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆247Updated this week
• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆194Updated last week
• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,068Updated this week
• VIDA-NYU / ache
  ACHE is a web crawler for domain-specific search.
  ☆472Updated 2 weeks ago
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,122Updated 7 years ago
• lucidworks / banana
  Banana for Solr - A Port of Kibana
  ☆671Updated last month
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆220Updated 2 years ago
• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆325Updated 3 years ago
• carrot2 / carrot2
  Carrot2: Text Clustering Algorithms and Applications
  ☆824Updated last week
• crawljax / crawljax
  Crawljax
  ☆530Updated last year
• spinscale / elasticsearch-ingest-opennlp
  An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP
  ☆274Updated 2 years ago
• optimaize / language-detector
  Language Detection Library for Java
  ☆582Updated 3 years ago
• jiminoc / goose
  Html Content / Article Extractor in Scala - open sourced from Gravity Labs - http://gravity.com
  ☆343Updated 6 years ago
• apache / gora
  The Apache Gora open source framework provides an in-memory data model and persistence for big data.
  ☆122Updated last year
• momer / nutch-selenium
  ☆28Updated 9 years ago
• lumifyio / lumify
  open source big data integration, analytics, and visualization
  ☆421Updated 8 years ago
• carrot2 / elasticsearch-carrot2
  Carrot2 plugin for ElasticSearch
  ☆291Updated 2 years ago
• unipop-graph / unipop
  Data Integration Graph
  ☆207Updated 7 years ago
• flaxsearch / luwak
  A java library for stored queries
  ☆378Updated 2 years ago
• querqy / querqy
  Query preprocessor for Java-based search engines (Querqy Core and Lucene implementation)
  ☆187Updated last week
• rayokota / hgraphdb
  HBase as a TinkerPop Graph Database
  ☆261Updated last week
• Anant / awesome-solr
  A curated list of Awesome Apache Solr links and resources.
  ☆109Updated 3 years ago
• apache / opennlp
  Apache OpenNLP
  ☆1,539Updated this week
• Netflix / netflix-graph
  Compact in-memory representation of directed graph data
  ☆563Updated 2 years ago
• internetarchive / heritrix3
  Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
  ☆3,059Updated last week
• actionml / universal-recommender
  Highly configurable recommender based on PredictionIO and Mahout's Correlated Cross-Occurrence algorithm
  ☆675Updated 6 years ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,883Updated 3 years ago
• apache / gobblin
  A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…
  ☆2,246Updated last week
• flaxsearch / marple
  Browser-driven explorer for lucene indexes
  ☆74Updated 4 years ago