richardlehane / webarchive
golang readers for ARC and WARC webarchive formats
☆21Updated last year
Alternatives and similar repositories for webarchive:
Users that are interested in webarchive are comparing it to the libraries listed below
- Read and write WARC files in Go☆44Updated 6 years ago
- Golang WARC (Web ARChive) Library☆29Updated 5 years ago
- A golang library to work with WARC files from the common crawl☆14Updated 6 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 11 years ago
- ☆27Updated 7 years ago
- A Memento Aggregator CLI and Server in Go☆61Updated 7 months ago
- OCFL implementation for Go☆13Updated last week
- Serve millions of JSON documents via HTTP.☆66Updated 2 months ago
- language-agnostic syntax for documenting & outlining packages☆9Updated 8 months ago
- Span formats.☆17Updated last week
- Package mbox parses the mbox file format into messages and formats messages into mbox files☆70Updated 2 years ago
- Digital Preservation of HTTP in documentary heritage.☆22Updated last year
- RAIS: A IIIF-compliant, 100% open source image server for blazing-fast deep zooming☆78Updated 2 months ago
- qri dataset definition☆15Updated 3 years ago
- Go package to parse GEDCOM files.☆38Updated 4 months ago
- ipLocator - a basic Geo-Ip Server☆70Updated 6 years ago
- ☆16Updated this week
- A JSON-LD processor for Go☆115Updated 6 years ago
- Command line tool for querying and retrieving records from OAI-PMI providers.☆10Updated 7 years ago
- 🕸 A simple way to extract data from Common Crawl☆33Updated 4 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 9 years ago
- A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format☆44Updated 2 years ago
- mediawiki dump parser for loading up wikipedia data☆102Updated last year
- A program to search text files for sentences that match 5-7-5 a syllable count.☆23Updated 6 years ago
- Summarizes text☆38Updated 9 years ago
- Docker image for the Archives Unleashed Toolkit☆12Updated 2 years ago
- simple base58 codec☆20Updated 7 years ago
- A mini LDP Server written in Go.☆11Updated 8 years ago
- A Reader/ReaderAt for Go that uses Range requests to get files over HTTP☆27Updated 2 years ago
- Go package to implement the IIIF Image API.☆90Updated last month