openzim / warc2zimLinks
Command line tool to convert a file in the WARC format to a file in the ZIM format
☆72Updated 7 months ago
Alternatives and similar repositories for warc2zim
Users that are interested in warc2zim are comparing it to the libraries listed below
Sorting:
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆129Updated 2 months ago
- Various ZIM command line tools☆178Updated this week
- A command line tool to archive a git repository from GitHub to the Internet Archive.☆91Updated 4 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆54Updated 7 years ago
- Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives☆16Updated 4 years ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆51Updated last week
- Create a ZIM file from a Youtube channel/username/playlist☆80Updated 3 weeks ago
- Nondestructive warc-in-tar to warc conversion☆27Updated 12 years ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- Farm operated by bots to grow and harvest new zim files☆119Updated this week
- A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format☆53Updated 2 years ago
- ☆78Updated 3 years ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac…☆55Updated 2 months ago
- Scrape posts, threads from forums, news aggregators, mail archives, export to JSONL, mailbox, WARC☆103Updated last year
- MediaWiki scraper: all your wiki articles in one highly compressed ZIM file☆404Updated last week
- Web archiving using Google Chrome☆46Updated 5 years ago
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆59Updated last year
- Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing…☆100Updated 3 weeks ago
- Collection of Python code to re-use across Python-based scrapers☆24Updated last week
- The ArchiveWeb.page Site☆30Updated this week
- Clean a series of links, resolving redirects and finding Wayback results if page is gone. Originally written to aid with importing from A…☆18Updated last year
- A self-hosted bookmark database with full-text page content search☆96Updated 5 months ago
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en…☆18Updated 4 months ago
- Recover lost websites from the Web Infrastructure☆89Updated 3 months ago
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more …☆350Updated this week
- Scripts to build and boot warrior virtual machine containing Docker☆120Updated 7 months ago
- Archiving public telegram messages.☆15Updated 2 months ago
- Bundle external assets in a HTML file to distribute a stand-alone HTML document.☆39Updated 4 months ago
- Links on the web break all the time, robustify them!☆54Updated 4 years ago
- A framework for quick web archiving; canonical repository: https://gitea.arpa.li/JustAnotherArchivist/qwarc☆29Updated 4 years ago