slyrz / warc
Read and write WARC files in Go
☆45Updated 6 years ago
Alternatives and similar repositories for warc:
Users that are interested in warc are comparing it to the libraries listed below
- A golang library to work with WARC files from the common crawl☆15Updated 7 years ago
- golang readers for ARC and WARC webarchive formats☆21Updated last year
- Package mbox parses the mbox file format into messages and formats messages into mbox files☆71Updated 2 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 11 years ago
- A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split words, sentences and graphemes.☆54Updated 6 months ago
- CLD2 (Compact Language Detector 2) bindings for Go (golang)☆38Updated 5 years ago
- adding badger support to blevesearch☆62Updated 2 years ago
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆108Updated 2 years ago
- An implementation of the Goose HTML Content / Article Extractor algorithm in golang☆40Updated 3 years ago
- A Go implementation of the Cassowary constraint solving algorithm.☆76Updated 4 years ago
- Pure Go implementation of cryptographic APIs found in libsodium☆45Updated 4 years ago
- Golang package to extract useful text from a HTML document☆40Updated last year
- mediawiki dump parser for loading up wikipedia data☆103Updated last year
- An approximate string matching library for the Go programming language.☆177Updated 2 years ago
- 📖⏎ An efficient and flexible word-wrapping package for Go (golang)☆16Updated 4 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 9 years ago
- A generic patricia trie (also called radix tree) implemented in Go (Golang)☆28Updated 5 years ago
- A simple Go Library to calculate a phash string for a JPEG image.☆34Updated 9 years ago
- Self-organizing maps in Go☆74Updated 2 years ago
- simhash storage and searching☆138Updated 7 years ago
- Parse JPEG data into segments via code or CLI from pure Go. Read/export/write EXIF data. Read XMP and IPTC metadata.☆73Updated 2 years ago
- TLSH lib in Golang☆138Updated 2 years ago
- Command deadleaves finds and prints the import paths of unused Go packages.☆34Updated 8 years ago
- Package valuegraph produces a graph representation of any Go value.☆32Updated 7 years ago
- Wikidata API bindings in go.☆27Updated last year
- Meow hash for Golang☆126Updated 5 years ago
- Shutdown Management package for Go v2☆51Updated 2 years ago
- DKIM package for golang☆98Updated 2 weeks ago
- ☆21Updated last year
- A Reader/ReaderAt for Go that uses Range requests to get files over HTTP☆28Updated 2 years ago