Read and write WARC files in Go
☆50Apr 9, 2018Updated 8 years ago
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- golang readers for ARC and WARC webarchive formats☆20Apr 3, 2023Updated 3 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆25Jan 1, 2014Updated 12 years ago
- ☆18Mar 31, 2025Updated last year
- Implementation of libsodium's secretstream in Go☆22Sep 11, 2026Updated last month
- Nondestructive warc-in-tar to warc conversion☆27Apr 21, 2013Updated 13 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- OCFL implementation for Go☆16Updated this week
- gemini server - gemini://gemini.circumlunar.space/ (https://gemini.circumlunar.space/)☆33Aug 25, 2021Updated 5 years ago
- CDXJ Indexing of WARC/ARCs☆37Oct 1, 2026Updated 2 weeks ago
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆18Sep 10, 2026Updated last month
- A Go-wrapper for the ncurses library.☆13Aug 11, 2026Updated 2 months ago
- A Go port of the Rapid Automatic Keyword Extraction algorithm (RAKE)☆124Jun 12, 2025Updated last year
- Experimental framework for working with IIIF in JavaScript and Typescript.☆18Feb 15, 2022Updated 4 years ago
- ☆15Oct 5, 2017Updated 9 years ago
- A command line utility for listing and searching snapshots in web archives☆20Jun 4, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A tool for collection archival slivers of the web and web archives☆20Jun 1, 2026Updated 4 months ago
- ☆12Jan 13, 2019Updated 7 years ago
- https://arxiv.org/html/2402.02668v2☆27Apr 23, 2025Updated last year
- Merging WARCs into a single WARC file☆15Aug 29, 2014Updated 12 years ago
- qri dataset definition☆15Sep 24, 2021Updated 5 years ago
- ☆26Sep 3, 2026Updated last month
- Block-level copy-on-write tool☆18Dec 17, 2024Updated last year
- versatile stream IO and RPC based IPC stack for Go☆41Oct 23, 2023Updated 2 years ago
- HTTP on top of libp2p☆68Aug 21, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- tools for working with directed acyclic graphs (DAGs)☆20Dec 8, 2022Updated 3 years ago
- Language-agnostic workflow builder. Modular code that goes from dev to prod in a minute with principled design decisions.☆14Mar 11, 2024Updated 2 years ago
- Serve HTTP on a tailnet☆21Oct 31, 2024Updated last year
- Python script to create CDX index files of WARC data☆16Sep 7, 2018Updated 8 years ago
- Create and manage chroot/jail environments☆51May 21, 2023Updated 3 years ago
- A client for the Archive-It And Webrecorder WASAPI Data Transfer API☆16Oct 18, 2019Updated 6 years ago
- A CLI for OCFL repositories☆23Jan 25, 2026Updated 8 months ago
- workspace for go-libp2p contributors☆20Nov 15, 2022Updated 3 years ago
- A fast URL parser for Go☆41Mar 4, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Command line tool for digging into WARC files☆51Aug 5, 2026Updated 2 months ago
- Comparing warc files☆17Feb 21, 2019Updated 7 years ago
- Neural network auditory processing code in Go focused on filtering speech wav files via mel filters☆11Jan 22, 2024Updated 2 years ago
- Parse WARC (Web Archive Files) as a node.js stream☆23Oct 20, 2014Updated 11 years ago
- A Memento Aggregator CLI and Server in Go☆83Apr 9, 2026Updated 6 months ago
- fondz is a tool for auto-generating an "archival description" from a bag or series of bags.☆26Jun 30, 2014Updated 12 years ago
- PKV is an implementation of Partial Key Verification in Go☆13Jul 25, 2020Updated 6 years ago