klauspost / dedupLinks
Streaming Deduplication Package for Go
☆198Updated 7 years ago
Alternatives and similar repositories for dedup
Users that are interested in dedup are comparing it to the libraries listed below
Sorting:
- Asynchronous read-ahead for Go readers☆238Updated last year
- a small circular ring buffer library in go / golang☆187Updated 6 years ago
- Fast hashing using pure Go implementation of BLAKE2b with SIMD instructions☆256Updated 8 years ago
- A generic lock-free implementation of the "Token-Bucket" algorithm☆147Updated 7 years ago
- Very fast, very unsafe serialization for Go☆147Updated 3 years ago
- Mount a BoltDB (https://github.com/boltdb/bolt) database as a FUSE filesystem;☆116Updated 5 years ago
- ZebraPack format is like gobs version 2: serialization in Go, *but* extremely fast and friendly to other languages. Use Go as your schema…☆171Updated 7 years ago
- A file backed circular buffer for Go. Mmap file into memory. Madvise to lower memory footprint.☆82Updated last year
- Implementation of the Jump Consistent Hash algorithm in Go.☆153Updated 11 years ago
- Non blocking data structures for Go☆267Updated 9 years ago
- An immutability helper for Go☆141Updated 9 years ago
- Measure and throttle the rate at which data is transferred.☆260Updated last year
- Package mafsa implements Minimal Acyclic Finite State Automata in Go, essentially a high-speed, memory-efficient, Unicode-friendly set of…☆295Updated 6 years ago
- Tools to process Go trace logs into various profiles. Complement for "go tool trace".☆109Updated 8 years ago
- Simple, ordered, key-value persistence library for the Go Language☆267Updated 4 years ago
- Minimal Perfect Hashing for Go☆191Updated last year
- goq: a distributed job queuing system in Go (golang). An "ultralight shell-script Kubernetes", if you like buzz words.☆93Updated 2 months ago
- A generic patricia trie (also called radix tree) implemented in Go (Golang)☆288Updated 5 months ago
- Package rehttp implements a Go HTTP transport that handles retries.☆225Updated last year
- Cross-language serialization for Golang: greenpack adds versioning, stronger typing, and optional schema atop msgpack2. `greenpack -msgpa…☆113Updated 7 months ago
- An optimized substring search engine written in Go☆548Updated 6 years ago
- Concurrent Buffered IO in Go #golang☆249Updated 3 years ago
- Parallel and radix sorting in Go☆101Updated 2 years ago
- a library for reliable and flow-controlled nats sessions using the sliding window protocol. Written in golang.☆58Updated 8 years ago
- Shutdown Management package for Go v2☆51Updated 3 years ago
- An approximate string matching library for the Go programming language.☆182Updated 3 years ago
- General, type-safe, non-allocating set-operations for any sort.Interface☆170Updated 7 years ago
- tool for detecting unused functions and variables in Go source code☆142Updated 6 years ago
- Easy column formatted output for golang☆167Updated 5 years ago
- Leaky bucket implementation in Go with support for different backends (redis, in-memory)☆87Updated last month