slyrz / warcLinks
Read and write WARC files in Go
☆47Updated 7 years ago
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below
Sorting:
- golang readers for ARC and WARC webarchive formats☆20Updated 2 years ago
- A golang library to work with WARC files from the common crawl☆15Updated 7 years ago
- Package mbox parses the mbox file format into messages and formats messages into mbox files☆75Updated 7 months ago
- mediawiki dump parser for loading up wikipedia data☆108Updated last month
- Generic data structures and utility types in Go☆26Updated last month
- Serve millions of JSON documents via HTTP.☆70Updated last year
- A Reader/ReaderAt for Go that uses Range requests to get files over HTTP☆28Updated 3 years ago
- CLD2 (Compact Language Detector 2) bindings for Go (golang)☆38Updated 6 years ago
- An approximate string matching library for the Go programming language.☆182Updated 3 years ago
- Self-organizing maps in Go☆74Updated 3 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 10 years ago
- Parse JPEG data into segments via code or CLI from pure Go. Read/export/write EXIF data. Read XMP and IPTC metadata.☆78Updated 3 years ago
- Command deadleaves finds and prints the import paths of unused Go packages.☆34Updated 9 years ago
- Pure Go implementation of cryptographic APIs found in libsodium☆45Updated 5 years ago
- A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split graphemes, words, sentences.☆95Updated last month
- Genex package for Go☆76Updated 6 years ago
- Removes most frequent words (stop words) from a text content. Based on a Curated list of language statistics.☆152Updated 2 years ago
- Detect malicious homoglyphs in Go source code☆47Updated 8 years ago
- Conflict-free replicated JSON implementation in native Go☆99Updated 4 years ago
- Fast integer map for uint32-to-uint32☆32Updated 6 months ago
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆115Updated 3 years ago
- A general purpose application which can be used to host read-only access to one or more Bleve indexes☆12Updated 9 years ago
- A simple perceptual hash library in pure Go.☆58Updated last year
- Go package to parse GEDCOM files.☆41Updated 2 months ago
- Golang package to extract useful text from a HTML document☆40Updated 2 years ago
- Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems☆52Updated 7 years ago
- Text summarizer for golang using LexRank☆137Updated 3 months ago
- A Go implementation of the Cassowary constraint solving algorithm.☆78Updated 5 years ago
- simhash storage and searching☆138Updated 8 years ago
- A generic patricia trie (also called radix tree) implemented in Go (Golang)☆29Updated 6 years ago