Alternatives and similar repositories for heritrix3

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,083Updated 2 weeks ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,609Updated 4 years ago
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,087Updated last month
• apache / stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆941Updated last week
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆998Updated 7 years ago
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,519Updated 3 months ago
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,573Updated this week
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆756Updated last week
• iipc / openwayback
  The OpenWayback Development
  ☆506Updated last year
• code4craft / jsoup-learning
  Jsoup学习笔记。添加了部分学习代码和注释。
  ☆636Updated last year
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,651Updated 2 months ago
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,992Updated 11 months ago
• code4craft / xsoup
  When jsoup meets XPath.
  ☆470Updated 2 years ago
• webrecorder / browsertrix-crawler
  Run a high-fidelity browser-based web archiving crawler in a single Docker container
  ☆901Updated this week
• oblac / jodd
  Jodd! Lightweight. Java. Zero dependencies. Use what you like.
  ☆4,074Updated last year
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,125Updated 7 years ago
• wycm / zhihu-crawler
  zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
  ☆917Updated 6 years ago
• zhangkaitao / es
  JavaEE项目开发脚手架（我的公众号：kaitao-1234567，我的新书：《亿级流量网站架构核心技术》）
  ☆2,157Updated 7 years ago
• internetarchive / wayback
  IA's public Wayback Machine (moved from SourceForge)
  ☆802Updated last year
• wks / ik-analyzer
  No longer maintained. Please contact the origional author.
  ☆666Updated 7 years ago
• apache / httpcomponents-client
  Mirror of Apache HttpClient
  ☆1,512Updated this week
• jfinal / jfinal
  JAVA WEB + ORM Framework
  ☆3,268Updated this week
• paoding-code / paoding-rose
  paoding-rose 提供最好用的Java Web应用整体性框架。
  ☆603Updated 6 years ago
• lionsoul2014 / jcseg
  Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywo…
  ☆919Updated 2 years ago
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,318Updated 4 months ago
• ysc / word
  Java分布式中文分词组件 - word分词
  ☆1,822Updated 4 years ago
• webmagic-io / jobhunter
  使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。
  ☆224Updated 8 years ago
• PatMartin / Dex
  Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizati…
  ☆1,321Updated 6 years ago
• jjjake / internetarchive
  A Python and Command-Line Interface to Archive.org
  ☆1,780Updated last week
• swaldman / c3p0
  a mature, highly concurrent JDBC Connection pooling library, with support for caching and reuse of PreparedStatements.
  ☆1,310Updated 2 months ago