Alternatives and similar repositories for heritrix3

Users that are interested in heritrix3 are comparing it to the libraries listed below

• apache / nutch
  Apache Nutch is an extensible and scalable web crawler
  ☆3,037Updated 2 months ago
• yasserg / crawler4j
  Open Source Web Crawler for Java
  ☆4,594Updated 3 years ago
• CrawlScript / WebCollector
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,073Updated 5 months ago
• internetarchive / brozzler
  brozzler - distributed browser-based web crawler
  ☆720Updated 2 weeks ago
• apache / stormcrawler
  A scalable, mature and versatile web crawler based on Apache Storm
  ☆919Updated this week
• xtuhcy / gecco
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,514Updated last year
• iipc / openwayback
  The OpenWayback Development
  ☆500Updated last year
• webrecorder / pywb
  Core Python Web Archiving Toolkit for replay and recording of web archives
  ☆1,517Updated last month
• code4craft / webmagic
  A scalable web crawler framework for Java.
  ☆11,578Updated last month
• ArchiveTeam / wpull
  Wget-compatible web downloader and crawler.
  ☆587Updated last year
• iipc / awesome-web-archiving
  An Awesome List for getting started with web archiving
  ☆2,291Updated 2 months ago
• zhegexiaohuozi / SeimiCrawler
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,988Updated 7 months ago
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,421Updated last year
• unofficial-openjdk / openjdk
  Do not send pull requests! Automated Git clone of various OpenJDK branches
  ☆2,161Updated 4 years ago
• cglib / cglib
  cglib - Byte Code Generation Library is high level API to generate and transform Java byte code. It is used by AOP, testing, data access …
  ☆4,857Updated 10 months ago
• qos-ch / logback
  The reliable, generic, fast and flexible logging framework for Java.
  ☆3,116Updated 2 months ago
• ehcache / ehcache3
  Ehcache 3.x line
  ☆2,049Updated last month
• json-path / JsonPath
  Java JsonPath implementation
  ☆9,143Updated 10 months ago
• ArchiveTeam / grab-site
  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
  ☆1,492Updated last month
• jetty / jetty.project
  Eclipse Jetty® - Web Container & Clients - supports HTTP/2, HTTP/1.1, HTTP/1.0, websocket, servlets, and more
  ☆3,954Updated this week
• quartz-scheduler / quartz
  Code for Quartz Scheduler
  ☆6,527Updated 2 months ago
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,040Updated 2 months ago
• Netflix / ribbon
  Ribbon is a Inter Process Communication (remote procedure calls) library with built in software load balancers. The primary usage model i…
  ☆4,605Updated last week
• apache / shiro
  Apache Shiro
  ☆4,382Updated last week
• Rhizome-Conifer / conifer
  Collect and revisit web pages.
  ☆1,505Updated 5 months ago
• apache / tika
  The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).
  ☆3,055Updated last week
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,161Updated 10 months ago
• oduwsdl / ipwb
  InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
  ☆638Updated last month
• apache / commons-lang
  Apache Commons Lang
  ☆2,807Updated this week
• internetarchive / warctools
  Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)
  ☆161Updated 3 weeks ago