A Rust library for reading and writing WARC files
☆61Nov 27, 2024Updated last year
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- C++ library to parse WARC files☆11Jan 27, 2019Updated 7 years ago
- CDXJ Indexing of WARC/ARCs☆37Oct 1, 2026Updated last week
- Texting Robots: A Rust native `robots.txt` parser with thorough unit testing☆28Feb 14, 2024Updated 2 years ago
- Use JSX as an Eleventy template language☆21May 29, 2023Updated 3 years ago
- Tools to Work with the Web Archive Ecosystem in R☆20Aug 20, 2017Updated 9 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆14Mar 20, 2019Updated 7 years ago
- 🗄️ A simple CLI for converting WARC to Parquet.☆117Feb 12, 2025Updated last year
- Scoop by Rusty Foster and the CMF running Kuro5hin and other websites☆12Apr 14, 2017Updated 9 years ago
- Supporting example for "A Rust SentencePiece implementation"☆20Jun 7, 2020Updated 6 years ago
- Web archive index server based on RocksDB☆46Sep 30, 2026Updated last week
- A small library for building fast and highly customizable web crawlers☆16Jan 4, 2023Updated 3 years ago
- An arithmetic coder for Rust.☆23May 24, 2023Updated 3 years ago
- IFIscripts is an open-source digital preservation tool which facilitates collection management workflows within the IFI and further afiel…☆31Nov 19, 2025Updated 10 months ago
- Tests for the Nintendo 3DS's ARM9 security processor☆24Dec 25, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en …☆20Jul 11, 2025Updated last year
- A Rust crate for helping write structs as binary data using ✨macro magic✨☆18Apr 17, 2020Updated 6 years ago
- The Historian's WARC Toolkit☆16May 14, 2015Updated 11 years ago
- A framework for creating digital exhibits by loading collection metadata directly from a CSV (such as a published Google Sheet!). See the…☆15Oct 2, 2026Updated last week
- Task-based Parallelism in Rust☆17Nov 17, 2021Updated 4 years ago
- Webrecorders DevTools Protocol Automation Library☆18Oct 18, 2022Updated 3 years ago
- Internet Archive's Sparkling Data Processing Library☆17May 4, 2026Updated 5 months ago
- Warcbase is an open-source platform for managing analyzing web archives☆162Dec 8, 2017Updated 8 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆178Aug 18, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Incredibly hack proof of concept of automatic Rust -> Swig pipeline using procedural macros☆17Jul 18, 2018Updated 8 years ago
- Libtransistor, for rust☆13Jan 30, 2018Updated 8 years ago
- Narwhal is a keyword and KEY NARRATIVE manager that creates language-aware classes. Because Narhwal does not use NLP it avoids complexity…☆12Oct 16, 2018Updated 7 years ago
- The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.☆157Sep 17, 2026Updated 3 weeks ago
- Bash scripts to manage LTO cartridges with LTFS☆46Nov 30, 2025Updated 10 months ago
- r2 the Rhme3! The RHme (Riscure Hack me) is a low level hardware CTF that comes in the form of an Arduino board (AVR architecture). It in…☆17Oct 6, 2017Updated 9 years ago
- Boost voronoi ported to rust☆10Dec 8, 2023Updated 2 years ago
- BLAS for Rust☆16May 12, 2020Updated 6 years ago
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆445Sep 17, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- [WIP] Molten - Style-preserving TOML parser.☆42Apr 14, 2018Updated 8 years ago
- A native Rust port of Google's robots.txt parser and matcher C++ library.☆102Feb 13, 2021Updated 5 years ago
- a javascript porting of C's wcwidth()☆12Mar 19, 2026Updated 6 months ago
- A pushdown automaton low memory JSON bytes stream checker☆13Dec 24, 2021Updated 4 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆193Apr 29, 2022Updated 4 years ago
- A simple program for the TI MSP432P401R launchpad which uses the msp432p401r crate☆12Feb 5, 2018Updated 8 years ago
- Low Level ARM Machine Amulator - but really, a low-level emulator for the Nintendo 3DS. Main focus on its ARM9 security processor.☆56Feb 17, 2022Updated 4 years ago