Read and write WARC files in Go
☆50Apr 9, 2018Updated 7 years ago
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- golang readers for ARC and WARC webarchive formats☆20Apr 3, 2023Updated 2 years ago
- A golang library to work with WARC files from the common crawl☆15Feb 20, 2018Updated 8 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆25Jan 1, 2014Updated 12 years ago
- Webrecorders DevTools Protocol Automation Library☆18Oct 18, 2022Updated 3 years ago
- Implementation of libsodium's secretstream in Go☆21Mar 17, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A tool to scrape the ipfs network for information on the number of peers in the network.☆21Mar 22, 2024Updated 2 years ago
- ☆15Oct 5, 2017Updated 8 years ago
- versatile stream IO and RPC based IPC stack for Go☆40Oct 23, 2023Updated 2 years ago
- ☆26Oct 6, 2021Updated 4 years ago
- https://arxiv.org/html/2402.02668v2☆23Apr 23, 2025Updated 11 months ago
- Primitives and routines for 2D shapes, curves, and paths. A port of kurbo.☆11Mar 26, 2025Updated last year
- Web application to allow users to add content metadata about crawled resources☆13Feb 15, 2018Updated 8 years ago
- OCFL implementation for Go☆16Feb 6, 2026Updated last month
- Python script to create CDX index files of WARC data☆16Sep 7, 2018Updated 7 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Martin's HTTP package☆14Dec 1, 2025Updated 3 months ago
- ☆11Nov 21, 2025Updated 4 months ago
- A Go-wrapper for the ncurses library.☆12Dec 14, 2023Updated 2 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆56Oct 21, 2018Updated 7 years ago
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆17Mar 11, 2025Updated last year
- A dockerized, queued high fidelity web archiver based on Squidwarc☆62Jul 9, 2024Updated last year
- DASL — Data-Addressed Structures & Links☆24Mar 9, 2026Updated 2 weeks ago
- A tool for collection archival slivers of the web and web archives☆17Feb 18, 2025Updated last year
- A Go port of the Rapid Automatic Keyword Extraction algorithm (RAKE)☆122Jun 12, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Tiny Go libraries that I keep copying between projects☆12Mar 19, 2026Updated last week
- go package to chain fs.FS filesystems together (go1.16+)☆28Feb 23, 2023Updated 3 years ago
- ☆12Jan 13, 2019Updated 7 years ago
- Experimental framework for working with IIIF in JavaScript and Typescript.☆18Feb 15, 2022Updated 4 years ago
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆97Apr 22, 2025Updated 11 months ago
- A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format☆54Dec 5, 2022Updated 3 years ago
- Generic data structures and utility types in Go☆28Mar 14, 2026Updated last week
- tools for working with directed acyclic graphs (DAGs)☆20Dec 8, 2022Updated 3 years ago
- Bridge to the Internet creates a platform for hyper local network infrastructure to minimize resources required for networked communicati…☆19Dec 12, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Package unique provides primitives for finding unique elements of types that implement sort.Interface.☆25Aug 18, 2015Updated 10 years ago
- Serve HTTP on a tailnet☆22Oct 31, 2024Updated last year
- A simple, script-driven continuous integration (build - > test -> release) tool, with no external dependencies.☆14Dec 4, 2016Updated 9 years ago
- Create and manage chroot/jail environments☆51May 21, 2023Updated 2 years ago
- HTTP basic auth middleware for golang☆22Mar 16, 2023Updated 3 years ago
- fuse based filesystem that notifies you when changes happen☆40May 21, 2015Updated 10 years ago
- Command line tool for digging into WARC files☆51Feb 27, 2026Updated 3 weeks ago