openzim / warc2zimLinks
Command line tool to convert a file in the WARC format to a file in the ZIM format
☆75Updated 8 months ago
Alternatives and similar repositories for warc2zim
Users that are interested in warc2zim are comparing it to the libraries listed below
Sorting:
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆130Updated 3 months ago
- Various ZIM command line tools☆180Updated last month
- A list of things related to software, literature, and other content for 🕣 Memento☆102Updated last year
- Create a ZIM file from a Youtube channel/username/playlist☆83Updated 3 weeks ago
- A command line tool to archive a git repository from GitHub to the Internet Archive.☆92Updated 4 years ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆53Updated 3 weeks ago
- Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives☆16Updated 4 years ago
- Nondestructive warc-in-tar to warc conversion☆27Updated 12 years ago
- ☆78Updated 3 years ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆54Updated 7 years ago
- Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing…☆105Updated last month
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆58Updated last year
- Farm operated by bots to grow and harvest new zim files☆171Updated this week
- The ArchiveWeb.page Site☆30Updated last month
- 🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.☆181Updated 3 months ago
- MediaWiki scraper: all your wiki articles in one highly compressed ZIM file☆412Updated last week
- Clean a series of links, resolving redirects and finding Wayback results if page is gone. Originally written to aid with importing from A…☆18Updated 3 weeks ago
- Scrape posts, threads from forums, news aggregators, mail archives, export to JSONL, mailbox, WARC☆105Updated last year
- Reference implementation of the ZIM specification☆217Updated this week
- Collection of Python code to re-use across Python-based scrapers☆25Updated 2 weeks ago
- Recover lost websites from the Web Infrastructure☆89Updated 4 months ago
- Scripts to build and boot warrior virtual machine containing Docker☆122Updated 8 months ago
- wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improved☆30Updated 2 months ago
- Kiwix & openZIM build engine☆109Updated 2 weeks ago
- Web archiving using Google Chrome☆46Updated 5 years ago
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more …☆363Updated last week
- A simple terminal based Gemini client☆44Updated last month
- Saves proxied HTTP traffic to a WARC file.☆28Updated 12 years ago
- Community spaces, consent, privacy, transparency, online.☆27Updated this week