openzim / warc2zimLinks
Command line tool to convert a file in the WARC format to a file in the ZIM format
☆75Updated last week
Alternatives and similar repositories for warc2zim
Users that are interested in warc2zim are comparing it to the libraries listed below
Sorting:
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆131Updated last week
- A list of things related to software, literature, and other content for 🕣 Memento☆104Updated 2 weeks ago
- Various ZIM command line tools☆185Updated 2 months ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆55Updated 2 months ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- A command line tool to archive a git repository from GitHub to the Internet Archive.☆92Updated 4 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆169Updated 5 months ago
- Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives☆16Updated 4 years ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac…☆57Updated 5 months ago
- ☆78Updated 3 years ago
- Nondestructive warc-in-tar to warc conversion☆27Updated 12 years ago
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆58Updated last year
- Clean a series of links, resolving redirects and finding Wayback results if page is gone. Originally written to aid with importing from A…☆18Updated 2 months ago
- Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing…☆107Updated 3 months ago
- A dockerized, queued high fidelity web archiver based on Squidwarc☆60Updated last year
- Create a ZIM file from a Youtube channel/username/playlist☆84Updated last month
- Javascript/Node wrapper around Mozilla's Readability library so that ArchiveBox can call it as a oneshot CLI command to extract each page…☆42Updated last year
- Scrape posts, threads from forums, news aggregators, mail archives, export to JSONL, mailbox, WARC☆106Updated last year
- Kiwix Catalog BitTorrent Seeder Companion☆15Updated last month
- 🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.☆185Updated 4 months ago
- A self-hosted bookmark database with full-text page content search☆96Updated 8 months ago
- Reference implementation of the ZIM specification☆221Updated last week
- Bundle external assets in a HTML file to distribute a stand-alone HTML document.☆42Updated 7 months ago
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en…☆19Updated 6 months ago
- A python CLI to manage torrents for Library Genesis data.☆71Updated last year
- MediaWiki scraper: all your wiki articles in one highly compressed ZIM file☆417Updated last week
- A ServiceWorker for client-side reconstruction of composite mementos☆16Updated 10 months ago
- Farm operated by bots to grow and harvest new zim files☆185Updated last week
- Collection of Python code to re-use across Python-based scrapers☆25Updated this week
- Links on the web break all the time, robustify them!☆54Updated 5 years ago