Alternatives and similar repositories for heritrix3

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,121Updated this week
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,628Updated 4 years ago
• apache / stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆961Updated this week
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,091Updated 5 months ago
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,613Updated 2 weeks ago
• apache / lucene-solr
  Apache Lucene and Solr open-source search software
  ☆4,370Updated last year
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆785Updated this week
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,997Updated last year
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,517Updated 2 weeks ago
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆998Updated 7 years ago
• webrecorder / browsertrix-crawler
  Run a high-fidelity browser-based web archiving crawler in a single Docker container
  ☆968Updated this week
• code4craft / xsoup
  When jsoup meets XPath.
  ☆473Updated 2 weeks ago
• iipc / openwayback
  The OpenWayback Development
  ☆510Updated 2 years ago
• apache / solr
  Apache Solr open-source search software
  ☆1,564Updated this week
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,127Updated 8 years ago
• DmitryKey / luke
  This is mavenised Luke: Lucene Toolbox Project
  ☆1,548Updated 5 years ago
• jaeksoft / opensearchserver
  Open-source Enterprise Grade Search Engine Software
  ☆513Updated 3 years ago
• apache / mahout
  Apache Mahout - an environment for quickly creating scalable, performant machine learning applications.
  ☆2,204Updated this week
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,700Updated last month
• internetarchive / wayback
  IA's public Wayback Machine (moved from SourceForge)
  ☆819Updated last year
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆3,545Updated this week
• wks / ik-analyzer
  No longer maintained. Please contact the origional author.
  ☆665Updated 7 years ago
• DeemOpen / zkui
  A UI dashboard that allows CRUD operations on Zookeeper.
  ☆2,387Updated 2 years ago
• ArchiveTeam / grab-site
  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
  ☆1,549Updated 8 months ago
• jjjake / internetarchive
  A Python and Command-Line Interface to Archive.org
  ☆1,832Updated this week
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,087Updated 3 weeks ago
• apache / hbase
  Apache HBase
  ☆5,581Updated this week
• searchbox-io / Jest
  Elasticsearch Java Rest Client.
  ☆2,108Updated 2 years ago
• ehcache / ehcache3
  Ehcache 3.x line
  ☆2,077Updated 3 weeks ago
• unofficial-openjdk / openjdk
  Do not send pull requests! Automated Git clone of various OpenJDK branches
  ☆2,142Updated 5 years ago