Alternatives and similar repositories for heritrix3

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,049Updated 2 weeks ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,596Updated 3 years ago
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,074Updated 6 months ago
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,516Updated 3 weeks ago
• webrecorder / browsertrix-crawler
  Run a high-fidelity browser-based web archiving crawler in a single Docker container
  ☆836Updated last week
• iipc / awesome-web-archiving
  An Awesome List for getting started with web archiving
  ☆2,326Updated 3 months ago
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆3,125Updated this week
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,599Updated 3 weeks ago
• gsh199449 / spider
  A configurable web spider with a easy-to-use web console
  ☆997Updated 6 years ago
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,989Updated 8 months ago
• code4craft / xsoup
  When jsoup meets XPath.
  ☆468Updated 2 years ago
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,437Updated last year
• code4craft / jsoup-learning
  Jsoup学习笔记。添加了部分学习代码和注释。
  ☆636Updated last year
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,052Updated last week
• apache / lucene-solr
  Apache Lucene and Solr open-source search software
  ☆4,375Updated 10 months ago
• mybatis / generator
  A code generator for MyBatis.
  ☆5,306Updated 2 weeks ago
• apache / shiro
  Apache Shiro
  ☆4,393Updated last week
• yinchuandong / JavaVerify
  A Java CAPTCHA recognition library for sticky characters
  ☆207Updated 10 years ago
• kohlschutter / boilerpipe
  Work in progress transmit from Google Code
  ☆1,119Updated 7 years ago
• HaraldWalker / user-agent-utils
  Utilities for processing user-agent strings. Can be used to handle http requests in real-time or to analyze log files.
  ☆916Updated 2 years ago
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,314Updated 2 months ago
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,169Updated last year
• wks / ik-analyzer
  No longer maintained. Please contact the origional author.
  ☆665Updated 7 years ago
• webrecorder / replayweb.page
  Serverless replay of web archives directly in the browser
  ☆819Updated 2 weeks ago
• yuki-lau / weibo-spider
  新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...
  ☆354Updated 11 years ago
• wycm / zhihu-crawler
  zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
  ☆915Updated 6 years ago
• webmagic-io / jobhunter
  使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。
  ☆224Updated 8 years ago
• apache / mahout
  Mirror of Apache Mahout
  ☆2,171Updated this week
• oblac / jodd
  Jodd! Lightweight. Java. Zero dependencies. Use what you like.
  ☆4,065Updated last year
• apache / activemq
  Apache ActiveMQ Classic
  ☆2,383Updated 2 weeks ago