Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
☆137Mar 19, 2026Updated 4 months ago
Alternatives and similar repositories for wget-lua
Users that are interested in wget-lua are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Making a reusable toolkit for writing seesaw scripts☆76Jul 17, 2026Updated 3 weeks ago
- Wget-compatible web downloader and crawler.☆613Apr 29, 2024Updated 2 years ago
- The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns☆1,604May 23, 2025Updated last year
- Run a high-fidelity browser-based web archiving crawler in a single Docker container☆1,103Updated this week
- The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project☆28Jul 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Archiving public telegram messages.☆18Jul 5, 2026Updated last month
- Read and write WARC files in Go☆53Updated this week
- Centralised repository for WARC usage specifications.☆130Apr 4, 2026Updated 4 months ago
- Web site for the Squash Compression Benchmark☆19Feb 16, 2018Updated 8 years ago
- Counting the collisions with perl hash tables per function☆12Jun 5, 2019Updated 7 years ago
- A Tool To Push Web Resources Into Web Archives☆434Jan 23, 2024Updated 2 years ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆58Updated this week
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- A configurable, reusable tracker with dashboard☆36Dec 15, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 💾 YouTube video metadata archiver written in Golang☆21Dec 21, 2019Updated 6 years ago
- novel high throughput entropy encoder for BWT data☆15Aug 10, 2022Updated 4 years ago
- Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives☆16Jun 10, 2021Updated 5 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆55Oct 21, 2018Updated 7 years ago
- Decentralized web archiving☆20Aug 7, 2018Updated 8 years ago
- ☆63Apr 11, 2024Updated 2 years ago
- WARC writing MITM HTTP/S proxy☆461Jun 17, 2026Updated last month
- Command line tool to convert a file in the WARC format to a file in the ZIM format☆86Jul 31, 2026Updated last week
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆101Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PHP client for Search/Retrieve via URL (SRU)☆17Mar 11, 2024Updated 2 years ago
- Homographs: brutefind homographs within a font☆19Apr 21, 2017Updated 9 years ago
- ArchiveBot, an IRC bot for archiving websites☆419Apr 17, 2026Updated 3 months ago
- A MyBB plugin that upgrades the password hash algorithm and converts old passwords on the fly.☆10Nov 17, 2023Updated 2 years ago
- NOTE: This project is no longer being actively developed.. Check out https://replayweb.page / https://github.com/webrecorder/replayweb.pa…☆203Jan 22, 2025Updated last year
- 🖥️ Custom Flask + Jinja2 static site generator and content powering Monadical.com☆10Updated this week
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.☆55Dec 4, 2023Updated 2 years ago
- Extended globbing in modern C++☆15Dec 24, 2025Updated 7 months ago
- A Modern Player for Zillions☆19Dec 12, 2025Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Precomp, C++ version - further compress already compressed files☆32Dec 12, 2023Updated 2 years ago
- A set of Docker images for streaming a remote desktop video and audio☆27May 15, 2023Updated 3 years ago
- Core Python Web Archiving Toolkit for replay and recording of web archives☆1,687Apr 10, 2026Updated 4 months ago
- A GitHub Action to find and annotate vulnerable Go code☆15Aug 3, 2026Updated last week
- ☆10Updated this week
- JS Streaming WARC IO optimized for Browser and Node☆55Jul 27, 2026Updated 2 weeks ago
- code for twitter bot @wayback_exe☆49Sep 24, 2025Updated 10 months ago