chfoo / warcat-rs
Command-line tool and Rust library for handling Web ARChive (WARC) files
☆14Updated 3 months ago
Alternatives and similar repositories for warcat-rs:
Users that are interested in warcat-rs are comparing it to the libraries listed below
- Command line tool for digging into WARC files☆38Updated this week
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.☆30Updated 2 months ago
- A tool for detecting viruses and NSFW material in WARC files☆11Updated 6 months ago
- Document your SQLite tables and columns with in-line comments☆24Updated last year
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.☆54Updated last year
- ☆10Updated 3 years ago
- 🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.☆150Updated this week
- Save data from Mastodon to a SQLite database☆28Updated 8 months ago
- Static Site Generator for Viewing Web Archives (in WACZ) format☆22Updated last year
- Adds a reconciliation API endpoint to Datasette, based on the Reconciliation Service API specification.☆23Updated last year
- A CLI tool to find the dominant colours in an image 🎨☆98Updated last week
- Downloads and imports Wikipedia page histories to a git repository☆34Updated 2 months ago
- Converts WARC files to static HTML☆43Updated 8 months ago
- Web application for distributed compute analysis of Archive-It web archive collections.☆15Updated 6 months ago
- A command line utility for listing and searching snapshots in web archives☆15Updated last year
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆13Updated 2 weeks ago
- Convert an online sitemap to Atom, RSS and JSON feeds☆62Updated last year
- A Github Action for turning Markdown into ReSpec HTML☆14Updated 8 months ago
- A static site generator for Git repositories☆65Updated last month
- Bad link reporter for GitHub repositories☆12Updated 11 months ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆25Updated 7 months ago
- Follow the cryptocurrency industry’s influence on 2024 elections in the United States.☆32Updated 3 months ago
- Digital Preservation of HTTP in documentary heritage.☆22Updated last year
- 🗄️ A simple CLI for converting WARC to Parquet.☆109Updated 2 weeks ago
- Command line tool to convert a file in the WARC format to a file in the ZIM format☆54Updated 2 weeks ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac…☆51Updated 2 weeks ago