kbullaughey / warc-tools
Miscellaneous tools for processing WARC files from the CommonCrawl
☆24Updated 11 years ago
Alternatives and similar repositories for warc-tools:
Users that are interested in warc-tools are comparing it to the libraries listed below
- A distributed forward caching proxy for Go's http.Client supporting TLS☆31Updated 7 years ago
- Go language library for transmitting objects (including ones with channels) over the network using channels.☆73Updated 11 years ago
- Fast identification of character sequences in text or documents (multi-lingual)☆18Updated 9 years ago
- Online Change Detection Algorithm☆53Updated 4 years ago
- Simple Go implementation of the Porter Stemmer algorithm with powerful features.☆27Updated 3 years ago
- ☆18Updated 9 years ago
- Package atomicfile provides an atomically written/replaced file.☆51Updated 7 years ago
- An API optimized for processing timeseries data.☆35Updated 3 years ago
- A Go library which determines the dominant colors in an image.☆19Updated 9 years ago
- Temporary (disposable/throwaway) email detection library in Go(Golang)☆21Updated 9 years ago
- ☆12Updated 8 years ago
- All-in-one text tokenizer for Go. Super-fast. Lots of features.☆13Updated 9 years ago
- GNU Aspell spell checking library bindings for Go (golang)☆47Updated 4 years ago
- Various parsing utilities, such as IP, time, and top-level-domain, in Go☆25Updated 8 years ago
- 💧 In memory dataset filtering☆49Updated 3 years ago
- Summarizes text☆38Updated 9 years ago
- Dictionary Password Validation for Go☆49Updated 9 years ago
- ipLocator - a basic Geo-Ip Server☆71Updated 6 years ago
- Dendrite is a Go package that implements distributed hash table (DHT) based on Chord Protocol.☆30Updated 9 years ago
- [Go] FreeTree - generic binary-search-tree without any GC overhead☆45Updated 9 years ago
- A library to check if unwanted goroutines are still running at the end of a program run or test.☆17Updated 7 years ago
- Interlink Remote Applications☆21Updated 6 years ago
- Runlevel 1, you stay unix socket. Runlevel 3, you listen tcp! Kicks old process on boot. Shuts down when kicked by new process. Could con…☆23Updated 4 years ago
- Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems☆52Updated 6 years ago
- Ad hoc Cluster Monitoring Over SSH☆58Updated 9 years ago
- create low memory key/value objects in Go☆21Updated 8 years ago
- JSON-oriented HTTP server and client helpers☆38Updated 6 years ago
- A robust framing and encryption layer for your Go network programs, based on CurveZMQ.☆36Updated 7 years ago
- Generator of memorable passwords, written in Go☆64Updated 2 years ago
- Super-efficient, in-memory key/value data store☆21Updated 7 years ago