slyrz / warcLinks
Read and write WARC files in Go
☆47Updated 7 years ago
Alternatives and similar repositories for warc
Users that are interested in warc are comparing it to the libraries listed below
Sorting:
- A golang library to work with WARC files from the common crawl☆15Updated 7 years ago
- golang readers for ARC and WARC webarchive formats☆20Updated 2 years ago
- A Reader/ReaderAt for Go that uses Range requests to get files over HTTP☆28Updated 3 years ago
- Package mbox parses the mbox file format into messages and formats messages into mbox files☆74Updated 7 months ago
- mediawiki dump parser for loading up wikipedia data☆108Updated 2 months ago
- A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split graphemes, words, sentences.☆98Updated this week
- Readability is a library written in Go (golang) to parse, analyze and convert HTML pages into readable content. Originally an Arc90 Exper…☆122Updated 2 years ago
- CLD2 (Compact Language Detector 2) bindings for Go (golang)☆38Updated 6 years ago
- Removes most frequent words (stop words) from a text content. Based on a Curated list of language statistics.☆152Updated 2 years ago
- Generic data structures and utility types in Go☆26Updated last month
- An iCalendar library for Go☆67Updated 7 months ago
- Serve millions of JSON documents via HTTP.☆70Updated last year
- Self-organizing maps in Go☆74Updated 3 years ago
- Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems☆52Updated 7 years ago
- Golang package to extract useful text from a HTML document☆40Updated 2 years ago
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆115Updated 3 years ago
- A Go implementation of the Cassowary constraint solving algorithm.☆78Updated 5 years ago
- An approximate string matching library for the Go programming language.☆182Updated 3 years ago
- Takes a full name and splits it into individual name parts☆43Updated last year
- Go implementation of the JWZ email threading algorithm☆31Updated 2 years ago
- Go XML Pull Parser☆34Updated last year
- simhash storage and searching☆138Updated 8 years ago
- ☆32Updated last year
- Latent Dirichlet Allocation☆31Updated 3 years ago
- Genex package for Go☆76Updated 6 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 10 years ago
- A Go library to parse and format vCard☆123Updated last year
- Text summarizer for golang using LexRank☆137Updated 3 months ago
- A golang phonetics algorithm library☆31Updated 11 years ago
- pure golang spelling based on hunspell dictionaries☆41Updated 9 years ago