Alternatives and similar repositories for heritrix3

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,045Updated this week
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,075Updated 6 months ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,595Updated 3 years ago
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,515Updated last week
• apache / stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆922Updated this week
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,534Updated this week
• code4craft / xsoup
  When jsoup meets XPath.
  ☆468Updated 2 years ago
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆724Updated this week
• iipc / openwayback
  The OpenWayback Development
  ☆500Updated last year
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆998Updated 6 years ago
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,588Updated 2 weeks ago
• webrecorder / browsertrix-crawler
  Run a high-fidelity browser-based web archiving crawler in a single Docker container
  ☆831Updated this week
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,987Updated 7 months ago
• code4craft / jsoup-learning
  Jsoup学习笔记。添加了部分学习代码和注释。
  ☆636Updated last year
• internetarchive / wayback
  IA's public Wayback Machine (moved from SourceForge)
  ☆794Updated last year
• ArchiveTeam / grab-site
  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
  ☆1,504Updated last month
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,117Updated 7 years ago
• lionsoul2014 / jcseg
  Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywo…
  ☆921Updated last year
• Rhizome-Conifer / conifer
  Collect and revisit web pages.
  ☆1,506Updated 6 months ago
• iipc / awesome-web-archiving
  An Awesome List for getting started with web archiving
  ☆2,315Updated 3 months ago
• wks / ik-analyzer
  No longer maintained. Please contact the origional author.
  ☆665Updated 7 years ago
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆3,109Updated this week
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,049Updated 2 weeks ago
• ysc / word
  Java分布式中文分词组件 - word分词
  ☆1,819Updated 4 years ago
• xuxueli / xxl-crawler
  A lightweight web crawler framework.（Java爬虫框架）
  ☆730Updated 6 months ago
• NLPchina / ansj_seg
  ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典
  ☆6,525Updated last year
• yinchuandong / JavaVerify
  A Java CAPTCHA recognition library for sticky characters
  ☆207Updated 10 years ago
• swaldman / c3p0
  a mature, highly concurrent JDBC Connection pooling library, with support for caching and reuse of PreparedStatements.
  ☆1,305Updated last week
• yuki-lau / weibo-spider
  新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...
  ☆354Updated 11 years ago
• oblac / jodd
  Jodd! Lightweight. Java. Zero dependencies. Use what you like.
  ☆4,064Updated last year