Alternatives and similar repositories for heritrix3:

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,000Updated this week
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,074Updated 2 months ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,583Updated 3 years ago
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆695Updated this week
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,511Updated last year
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,475Updated this week
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆994Updated 6 years ago
• apache / incubator-stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆904Updated last week
• wycm / zhihu-crawler
  zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
  ☆915Updated 5 years ago
• iipc / openwayback
  The OpenWayback Development
  ☆497Updated last year
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,986Updated 4 months ago
• code4craft / jsoup-learning
  Jsoup学习笔记。添加了部分学习代码和注释。
  ☆639Updated last year
• jjjake / internetarchive
  A Python and Command-Line Interface to Archive.org
  ☆1,684Updated last week
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆2,886Updated last week
• code4craft / xsoup
  When jsoup meets XPath.
  ☆469Updated last year
• ArchiveTeam / wpull
  Wget-compatible web downloader and crawler.
  ☆579Updated 11 months ago
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,528Updated last month
• webrecorder / browsertrix-crawler
  Run a high-fidelity browser-based web archiving crawler in a single Docker container
  ☆726Updated this week
• CrawlScript / nutcher
  nutcher是中文的nutch文档，包含nutch的配置和源码解析，持续更新中。
  ☆130Updated 5 years ago
• apache / httpcomponents-client
  Mirror of Apache HttpClient
  ☆1,487Updated this week
• webrecorder / replayweb.page
  Serverless replay of web archives directly in the browser
  ☆774Updated 2 weeks ago
• internetarchive / wayback
  IA's public Wayback Machine (moved from SourceForge)
  ☆778Updated last year
• webmagic-io / jobhunter
  使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。
  ☆224Updated 8 years ago
• webrecorder / archiveweb.page
  A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!
  ☆962Updated 2 months ago
• apache / activemq
  Apache ActiveMQ Classic
  ☆2,348Updated 2 weeks ago
• brianway / webporter
  基于 webmagic 的 Java 爬虫应用
  ☆2,783Updated 3 years ago
• dom4j / dom4j
  flexible XML framework for Java
  ☆924Updated 3 weeks ago
• apache / struts
  Apache Struts is a free, open-source, MVC framework for creating elegant, modern Java web applications
  ☆1,313Updated last week
• ArchiveTeam / grab-site
  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
  ☆1,467Updated 8 months ago
• machawk1 / wail
  Web Archiving Integration Layer: One-Click User Instigated Preservation
  ☆370Updated 2 weeks ago