Alternatives and similar repositories for heritrix3

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,029Updated 2 months ago
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,072Updated 4 months ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,594Updated 3 years ago
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆713Updated last week
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,566Updated 3 weeks ago
• apache / stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆908Updated last week
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,515Updated last year
• code4craft / xsoup
  When jsoup meets XPath.
  ☆468Updated last year
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,511Updated last month
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆994Updated 6 years ago
• iipc / openwayback
  The OpenWayback Development
  ☆498Updated last year
• jfinal / jfinal
  JAVA WEB + ORM Framework
  ☆3,246Updated last week
• ArchiveTeam / wpull
  Wget-compatible web downloader and crawler.
  ☆584Updated last year
• apache / activemq
  Apache ActiveMQ Classic
  ☆2,359Updated last week
• ehcache / ehcache3
  Ehcache 3.x line
  ☆2,050Updated 2 weeks ago
• gigablast / open-source-search-engine
  Nov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD. From gigablast dot com…
  ☆1,571Updated last year
• code4craft / jsoup-learning
  Jsoup学习笔记。添加了部分学习代码和注释。
  ☆638Updated last year
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,987Updated 6 months ago
• internetarchive / warcprox
  WARC writing MITM HTTP/S proxy
  ☆404Updated this week
• CrawlScript / nutcher
  nutcher是中文的nutch文档，包含nutch的配置和源码解析，持续更新中。
  ☆130Updated 5 years ago
• qos-ch / logback
  The reliable, generic, fast and flexible logging framework for Java.
  ☆3,109Updated 2 months ago
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆3,022Updated this week
• apache / httpcomponents-client
  Mirror of Apache HttpClient
  ☆1,489Updated this week
• webrecorder / webrecorder-player
  Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)
  ☆446Updated 4 years ago
• Rhizome-Conifer / conifer
  Collect and revisit web pages.
  ☆1,502Updated 4 months ago
• apache / shiro
  Apache Shiro
  ☆4,380Updated this week
• ArchiveTeam / ArchiveBot
  ArchiveBot, an IRC bot for archiving websites
  ☆386Updated last week
• jetty / jetty.project
  Eclipse Jetty® - Web Container & Clients - supports HTTP/2, HTTP/1.1, HTTP/1.0, websocket, servlets, and more
  ☆3,950Updated this week
• iipc / awesome-web-archiving
  An Awesome List for getting started with web archiving
  ☆2,269Updated last month
• ArchiveTeam / grab-site
  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
  ☆1,485Updated 2 weeks ago