ronomon / deduplication
Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
☆72Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for deduplication
- Append-only key-value database on a distributed shared-log☆49Updated 2 months ago
- fixed-length integer trim☆33Updated last year
- Library implementing the storage and the query evaluation for a text search engine. It uses on a key value store database interface to st…☆47Updated 3 years ago
- A SQLite extension for extracting values from serialized Protobuf messages☆87Updated 2 years ago
- Initial work on SQLite and LMDB integration☆68Updated last year
- Fast implementation of Content Defined Chunking (CDC) based on a rolling Rabin Checksum in C.☆48Updated 10 years ago
- Keys and Secrets Management Service☆55Updated 6 years ago
- Compute xxHash hash codes for 8 keys in parallel☆46Updated 5 years ago
- A compact implementation of Dr. Askitis HatTrie☆80Updated 10 years ago
- WebR2sync+☆12Updated 7 years ago
- Direct IO helpers for block devices and regular files on FreeBSD, Linux, macOS and Windows.☆69Updated last year
- A fast substitution to the stdlib's strstr() sub-string search function.☆115Updated 9 years ago
- Fast Hash Functions Using AES Intrinsics☆79Updated 5 years ago
- EliasFanoCompression: quasi-succinct compression of sorted integers in C#☆42Updated 3 years ago
- A not-yet-ready-for-use FoundationDB-backed FUSE filesystem. Seriously, don't use it.☆12Updated 6 months ago
- actordb storage engine☆19Updated 4 years ago
- Batch Monitor - Gain performance by combining work from multiple threads into a single batch☆31Updated 9 years ago
- MergedTrie code☆12Updated 4 years ago
- a hash-based key-value database for persistent storing massive small records☆41Updated 10 years ago
- HTTP benchmark utility☆21Updated last year
- ☆27Updated 2 years ago
- Concurrent trie-hash map library☆89Updated last year
- The dream accurate approximate set cardinality estimator based on 3-bit HyperLogLog. More accurate than Redis HyperLogLog.☆55Updated 3 years ago
- Automatically exported from code.google.com/p/smhasher☆16Updated 3 years ago
- mpool UAPI and CLI for HSE 1.x☆35Updated 3 years ago
- A CPace PAKE implementation using libsodium.☆35Updated 3 years ago
- Backtrace.io's resilient log record framing format☆36Updated 2 years ago
- a quotient filter written in C☆84Updated 7 years ago
- A C library implementation of a Cuckoo Filter☆23Updated 3 years ago
- Persistent, read-only, FUSE-based caching file system☆16Updated 4 years ago