slyrz / warcLinks
Read and write WARC files in Go
☆45Updated 7 years ago
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below
Sorting:
- golang readers for ARC and WARC webarchive formats☆20Updated 2 years ago
- A golang library to work with WARC files from the common crawl☆14Updated 7 years ago
- CLD2 (Compact Language Detector 2) bindings for Go (golang)☆38Updated 5 years ago
- High Performance Porter2 Stemmer☆46Updated 4 years ago
- Package mbox parses the mbox file format into messages and formats messages into mbox files☆72Updated this week
- Stemmer packages for Go programming language. Includes English, German and Dutch stemmers.☆53Updated 8 years ago
- A generic patricia trie (also called radix tree) implemented in Go (Golang)☆28Updated 6 years ago
- mediawiki dump parser for loading up wikipedia data☆103Updated last week
- Parse JPEG data into segments via code or CLI from pure Go. Read/export/write EXIF data. Read XMP and IPTC metadata.☆76Updated 2 years ago
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆110Updated 3 years ago
- A Go package that implements the JusText boilerplate removal algorithm☆109Updated 2 years ago
- simhash storage and searching☆138Updated 8 years ago
- Package valuegraph produces a graph representation of any Go value.☆32Updated 7 years ago
- Pure Go implementation of cryptographic APIs found in libsodium☆45Updated 4 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 9 years ago
- An implementation of the Goose HTML Content / Article Extractor algorithm in golang☆40Updated 4 years ago
- An approximate string matching library for the Go programming language.☆177Updated 2 years ago
- generate template FuncMap helpers to construct struct literals within a Go template☆37Updated last year
- Golang WARC (Web ARChive) Library☆30Updated 5 years ago
- Command deadleaves finds and prints the import paths of unused Go packages.☆34Updated 8 years ago
- A Go library for performing Unicode Text Segmentation as described in Unicode Standard Annex #29☆89Updated 2 years ago
- Takes a full name and splits it into individual name parts☆43Updated 7 months ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 11 years ago
- Text summarizer for golang using LexRank☆129Updated last year
- Access Times for files #golang☆42Updated 3 years ago
- A simple, lightweight, embedded geocoder for Golang with city level accuracy☆73Updated 9 years ago
- Offline language detection☆47Updated 7 years ago
- Heatmap creation stuff for go.☆112Updated 5 years ago
- MailHog SMTP Protocol☆75Updated 3 years ago
- Go XML Pull Parser☆34Updated 4 months ago