slyrz / warc
Read and write WARC files in Go
☆45Updated 6 years ago
Alternatives and similar repositories for warc:
Users that are interested in warc are comparing it to the libraries listed below
- A golang library to work with WARC files from the common crawl☆14Updated 7 years ago
- golang readers for ARC and WARC webarchive formats☆20Updated last year
- Golang WARC (Web ARChive) Library☆30Updated 5 years ago
- A Go package that implements the JusText boilerplate removal algorithm☆109Updated 2 years ago
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆108Updated 3 years ago
- CLD2 (Compact Language Detector 2) bindings for Go (golang)☆38Updated 5 years ago
- Package valuegraph produces a graph representation of any Go value.☆32Updated 7 years ago
- A generic patricia trie (also called radix tree) implemented in Go (Golang)☆28Updated 5 years ago
- High Performance Porter2 Stemmer☆46Updated 4 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 9 years ago
- Stemmer packages for Go programming language. Includes English, German and Dutch stemmers.☆53Updated 8 years ago
- Package mbox parses the mbox file format into messages and formats messages into mbox files☆71Updated 2 years ago
- A Go implementation of the Cassowary constraint solving algorithm.☆76Updated 4 years ago
- Text summarizer for golang using LexRank☆128Updated last year
- singlefile implements a host wide locking mechanism.☆34Updated 10 years ago
- mediawiki dump parser for loading up wikipedia data☆103Updated last year
- simhash storage and searching☆138Updated 7 years ago
- Go XML Pull Parser☆34Updated 2 months ago
- pure golang spelling based on hunspell dictionaries☆41Updated 9 years ago
- Parse JPEG data into segments via code or CLI from pure Go. Read/export/write EXIF data. Read XMP and IPTC metadata.☆73Updated 2 years ago
- Golang package to extract useful text from a HTML document☆40Updated last year
- equinox SDK to check/apply updates☆50Updated 4 years ago
- Self-organizing maps in Go☆74Updated 2 years ago
- Shutdown Management package for Go v2☆51Updated 2 years ago
- go library for opening URLs in web browsers☆10Updated 8 years ago
- A library for abstracting away from the literal Go time library, for testing and time control.☆58Updated last year
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 11 years ago
- The robots.txt exclusion protocol implementation for Go language☆273Updated 2 years ago
- Genex package for Go☆76Updated 5 years ago
- An approximate string matching library for the Go programming language.☆177Updated 2 years ago