chfoo / warcat-rsLinks
Command-line tool and Rust library for handling Web ARChive (WARC) files
☆24Updated 2 months ago
Alternatives and similar repositories for warcat-rs
Users that are interested in warcat-rs are comparing it to the libraries listed below
Sorting:
- ☆51Updated last year
- Download and attach provenance to public datasets☆33Updated 4 months ago
- A tool for collection archival slivers of the web and web archives☆13Updated 5 months ago
- 🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.☆166Updated last month
- Command line tool for digging into WARC files☆44Updated 2 weeks ago
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.☆35Updated 3 months ago
- Specifications developed and maintained by the Webrecorder community.☆132Updated 7 months ago
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.☆54Updated last year
- Adds a reconciliation API endpoint to Datasette, based on the Reconciliation Service API specification.☆24Updated last year
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆86Updated 3 months ago
- ☆11Updated last month
- A command line utility for listing and searching snapshots in web archives☆16Updated last year
- High performance RSS, Atom and RDF parser in Python.☆144Updated this week
- A simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service☆180Updated 9 months ago
- Save data from Mastodon to a SQLite database☆28Updated last month
- Static Site Generator for Viewing Web Archives (in WACZ) format☆27Updated 2 years ago
- Document your SQLite tables and columns with in-line comments☆24Updated 2 years ago
- Downloads and imports Wikipedia page histories to a git repository☆35Updated 7 months ago
- Centralised repository for WARC usage specifications.☆115Updated 8 months ago
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en…☆19Updated 3 weeks ago
- Create and edit WARC and WACZ files☆12Updated 8 months ago
- Converts WARC files to static HTML☆46Updated last year
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆15Updated 4 months ago
- Find possible host names in a source text☆53Updated 2 years ago
- A Memento Aggregator CLI and Server in Go☆67Updated 5 months ago
- A fun tool for quickly browsing unsourced snippets on Wikipedia.☆111Updated last week
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆44Updated last week
- A command line tool to archive a git repository from GitHub to the Internet Archive.☆94Updated 4 years ago
- Python IMage MIning☆14Updated 4 months ago
- Platform for journalists to search, analyse, categorise and share unstructured data☆55Updated this week