mediawiki-client-tools / mediawiki-dump-generatorLinks
Python 3 tools for downloading and preserving wikis
☆125Updated last week
Alternatives and similar repositories for mediawiki-dump-generator
Users that are interested in mediawiki-dump-generator are comparing it to the libraries listed below
Sorting:
- archiving MediaWikis (and uploading wikidump to the Internet Archive)☆76Updated 3 weeks ago
- A command line tool to archive a git repository from GitHub to the Internet Archive.☆92Updated 4 years ago
- Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now☆138Updated 9 months ago
- MediaWiki scraper: all your wiki articles in one highly compressed ZIM file☆415Updated 2 weeks ago
- A framework for quick web archiving; canonical repository: https://gitea.arpa.li/JustAnotherArchivist/qwarc☆30Updated this week
- A collection of tools for archiving and analysing the internet.☆75Updated 3 years ago
- Specifications developed and maintained by the Webrecorder community.☆139Updated 3 months ago
- Tool and library for handling Web ARChive (WARC) files.☆164Updated last year
- Archiving imgur.☆62Updated 5 months ago
- A tool for archiving DokuWiki☆25Updated 2 months ago
- Scripts to build and boot warrior virtual machine containing Docker☆122Updated 9 months ago
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more …☆382Updated this week
- wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improved☆30Updated 4 months ago
- Converts WARC files to static HTML☆49Updated 4 months ago
- ☆55Updated last year
- Discord archiver☆65Updated 2 years ago
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆131Updated this week
- Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2026, WikiTeam has preserved more th…☆809Updated last week
- Grabbing everything from reddit.☆61Updated last year
- Nondestructive warc-in-tar to warc conversion☆27Updated 12 years ago
- Use yt-dlp to download video/metadata and upload to the Internet Archive.☆475Updated 2 months ago
- Centralised repository for WARC usage specifications.☆120Updated 3 months ago
- Alternative Twitter front-end☆158Updated last year
- A lightweight static HTML generator for self-hosting video archives.☆128Updated last year
- 🕸 A frontend for the Wayback Machine which works on old browsers☆116Updated 2 months ago
- Archiving all metadata from YouTube (everything except videos themselves due to size)☆29Updated this week
- Sources for urls-grab.☆13Updated last week
- Web archive index server based on RocksDB☆37Updated 2 weeks ago
- Support for writing WARC files with Scrapy☆24Updated 6 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆169Updated 5 months ago