Alternatives and similar repositories for heritrix3:

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,005Updated 3 weeks ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,584Updated 3 years ago
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,072Updated 3 months ago
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,493Updated this week
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆703Updated last week
• iipc / openwayback
  The OpenWayback Development
  ☆497Updated last year
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,513Updated last year
• apache / incubator-stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆907Updated this week
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,395Updated 10 months ago
• ArchiveTeam / grab-site
  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
  ☆1,475Updated 9 months ago
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,985Updated 5 months ago
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆994Updated 6 years ago
• code4craft / jsoup-learning
  Jsoup学习笔记。添加了部分学习代码和注释。
  ☆638Updated last year
• oblac / jodd
  Jodd! Lightweight. Java. Zero dependencies. Use what you like.
  ☆4,060Updated last year
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,542Updated 3 weeks ago
• code4craft / xsoup
  When jsoup meets XPath.
  ☆468Updated last year
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,025Updated 2 weeks ago
• iipc / awesome-web-archiving
  An Awesome List for getting started with web archiving
  ☆2,229Updated 2 weeks ago
• grangier / python-goose
  Html Content / Article Extractor, web scrapping lib in Python
  ☆4,027Updated 3 years ago
• ehcache / ehcache3
  Ehcache 3.x line
  ☆2,045Updated 3 months ago
• apache / lucene-solr
  Apache Lucene and Solr open-source search software
  ☆4,376Updated 7 months ago
• Rhizome-Conifer / conifer
  Collect and revisit web pages.
  ☆1,500Updated 3 months ago
• yacy / yacy_search_server
  Distributed Peer-to-Peer Web Search Engine and Intranet Search Appliance
  ☆3,538Updated 2 weeks ago
• internetarchive / wayback
  IA's public Wayback Machine (moved from SourceForge)
  ☆783Updated last year
• zhangkaitao / es
  JavaEE项目开发脚手架（我的公众号：kaitao-1234567，我的新书：《亿级流量网站架构核心技术》）
  ☆2,161Updated 7 years ago
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆2,925Updated last week
• ArchiveTeam / ArchiveBot
  ArchiveBot, an IRC bot for archiving websites
  ☆381Updated 2 weeks ago
• machawk1 / wail
  Web Archiving Integration Layer: One-Click User Instigated Preservation
  ☆373Updated last month
• qinxuye / cola
  A high-level distributed crawling framework.
  ☆1,505Updated 2 years ago
• zhegexiaohuozi / SeimiAgent
  A headless,standalone webkit server which make grabing dynamic web page easier.
  ☆225Updated 6 years ago