Read and write WARC files in Go
☆50Apr 9, 2018Updated 8 years ago
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A golang library to work with WARC files from the common crawl☆15Feb 20, 2018Updated 8 years ago
- Golang WARC (Web ARChive) Library☆30Aug 6, 2019Updated 7 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆25Jan 1, 2014Updated 12 years ago
- ☆17Mar 31, 2025Updated last year
- Read and write WARC files in Go☆55Sep 14, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Webrecorders DevTools Protocol Automation Library☆18Oct 18, 2022Updated 3 years ago
- Implementation of libsodium's secretstream in Go☆22Sep 11, 2026Updated 2 weeks ago
- A tool to scrape the ipfs network for information on the number of peers in the network.☆21Mar 22, 2024Updated 2 years ago
- Egsam - Gemini client tester☆15Mar 11, 2021Updated 5 years ago
- Nondestructive warc-in-tar to warc conversion☆27Apr 21, 2013Updated 13 years ago
- ☆11Nov 21, 2025Updated 10 months ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆55Oct 21, 2018Updated 7 years ago
- CDXJ Indexing of WARC/ARCs☆37Sep 17, 2026Updated last week
- Automating description for Web Archives in ArchivesSpace using the Archive-It CDX and Partner Data APIs☆11Aug 10, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆18Sep 10, 2026Updated 2 weeks ago
- A dockerized, queued high fidelity web archiver based on Squidwarc☆62Jul 9, 2024Updated 2 years ago
- Server to manage mod packs for Minecraft☆12Updated this week
- A Go port of the Rapid Automatic Keyword Extraction algorithm (RAKE)☆124Jun 12, 2025Updated last year
- Experimental framework for working with IIIF in JavaScript and Typescript.☆18Feb 15, 2022Updated 4 years ago
- Go OCFL Implementation☆19Updated this week
- ☆12Jan 13, 2019Updated 7 years ago
- https://arxiv.org/html/2402.02668v2☆27Apr 23, 2025Updated last year
- Merging WARCs into a single WARC file☆15Aug 29, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆102Aug 28, 2026Updated 3 weeks ago
- qri dataset definition☆15Sep 24, 2021Updated 5 years ago
- A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format☆55Dec 5, 2022Updated 3 years ago
- ☆26Sep 3, 2026Updated 3 weeks ago
- Block-level copy-on-write tool☆18Dec 17, 2024Updated last year
- HTTP on top of libp2p☆68Aug 21, 2025Updated last year
- tools for working with directed acyclic graphs (DAGs)☆20Dec 8, 2022Updated 3 years ago
- Language-agnostic workflow builder. Modular code that goes from dev to prod in a minute with principled design decisions.☆14Mar 11, 2024Updated 2 years ago
- Serve HTTP on a tailnet☆21Oct 31, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- In-gallery iPad experience☆18Feb 24, 2016Updated 10 years ago
- Python script to create CDX index files of WARC data☆16Sep 7, 2018Updated 8 years ago
- Image to ascii art converter.☆14May 3, 2021Updated 5 years ago
- Create and manage chroot/jail environments☆51May 21, 2023Updated 3 years ago
- A client for the Archive-It And Webrecorder WASAPI Data Transfer API☆16Oct 18, 2019Updated 6 years ago
- ☆28Jun 30, 2026Updated 2 months ago
- A CLI for OCFL repositories☆23Jan 25, 2026Updated 8 months ago