Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
☆140Oct 26, 2026Updated 3 weeks ago
Alternatives and similar repositories for wget-lua
Users that are interested in wget-lua are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improved☆32Sep 20, 2025Updated last year
- Making a reusable toolkit for writing seesaw scripts☆78Updated this week
- Wget-compatible web downloader and crawler.☆613Apr 29, 2024Updated 2 years ago
- URL-agnostic WARC dedupe server☆12Jun 6, 2026Updated 5 months ago
- Sources for urls-grab.☆16Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns☆1,617May 23, 2025Updated last year
- Archiving public telegram messages.☆17Nov 5, 2026Updated 2 weeks ago
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en…☆20Jul 11, 2025Updated last year
- Command line tool for digging into WARC files☆52Updated this week
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆60Updated this week
- Wget with Lua extension☆24Dec 17, 2015Updated 10 years ago
- The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project☆28Jul 17, 2025Updated last year
- Run a high-fidelity browser-based web archiving crawler in a single Docker container☆1,200Updated this week
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆103Aug 28, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This package contains a tool for automatically cropping and deskewing images of book pages captured by an Internet Archive Scribe booksca…☆10Apr 25, 2013Updated 13 years ago
- Specifications developed and maintained by the Webrecorder community.☆145Nov 11, 2026Updated last week
- List of all pastebin.com analogs I know of. They are useful for finding leaked personal data☆22Jul 18, 2021Updated 5 years ago
- Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now☆152Apr 3, 2025Updated last year
- WARC writing MITM HTTP/S proxy☆470Jun 17, 2026Updated 5 months ago
- Counting the collisions with perl hash tables per function☆12Jun 5, 2019Updated 7 years ago
- Browser agnostic extension that enables pasting into password fields...☆15Jan 12, 2020Updated 6 years ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Oct 5, 2024Updated 2 years ago
- CDXJ Indexing of WARC/ARCs☆37Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ArchiveBot, an IRC bot for archiving websites☆429Sep 8, 2026Updated 2 months ago
- brozzler - distributed browser-based web crawler☆824Updated this week
- A configurable, reusable tracker with dashboard☆36Dec 15, 2023Updated 2 years ago
- Use yt-dlp to download video/metadata and upload to the Internet Archive.☆524Oct 27, 2026Updated 3 weeks ago
- External link tracking tool for Wikimedia partnerships☆11Oct 27, 2026Updated 3 weeks ago
- Streaming WARC/ARC library for fast web archive IO☆487Oct 28, 2026Updated 3 weeks ago
- Archiving URLs (outlinks) from a variety of sources.☆26Updated this week
- A Python and Command-Line Interface to Archive.org☆1,933Updated this week
- Centralised repository for WARC usage specifications.☆140Nov 9, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Core Python Web Archiving Toolkit for replay and recording of web archives☆1,720Updated this week
- Sublime Text API Version Documenter☆11Jan 3, 2023Updated 3 years ago
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.☆46Oct 9, 2026Updated last month
- Docker Container for grab-site☆13Aug 26, 2024Updated 2 years ago
- 💾 YouTube video metadata archiver written in Golang☆21Dec 21, 2019Updated 6 years ago
- ☆13Feb 9, 2025Updated last year
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆55Oct 21, 2018Updated 8 years ago
Are these results useful?