Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
☆75Mar 1, 2020Updated 6 years ago
Alternatives and similar repositories for deduplication
Users that are interested in deduplication are comparing it to the libraries listed below
Sorting:
- This package implements the FastCDC content defined chunking algorithm☆31Sep 30, 2020Updated 5 years ago
- FastCDC implementation in Rust☆186Feb 21, 2026Updated last month
- FastCDC implementation in Python https://pypi.org/project/fastcdc/☆63Jun 27, 2024Updated last year
- Multiple ways of chunking for data deduplication: Fixed size chunking, Content defined chunking, and File based chunking.☆19Dec 20, 2013Updated 12 years ago
- Turn an abstract-leveldown iterator into a readable stream.☆12Mar 1, 2023Updated 3 years ago
- JSON Web Token for redbean☆24Jul 3, 2024Updated last year
- Fast duplicate file detection library☆26Jan 5, 2017Updated 9 years ago
- ☆16Nov 10, 2015Updated 10 years ago
- D Text User Interface library☆12Jun 28, 2019Updated 6 years ago
- Constant-time hex and base64 codecs from libsodium reimplemented in Rust.☆16May 19, 2025Updated 10 months ago
- Automatically exported from code.google.com/p/servuino☆11Oct 8, 2018Updated 7 years ago
- A library for performing Content-Defined Chunking (CDC) on data streams.☆25Mar 8, 2023Updated 3 years ago
- Assume License: Boost☆12Aug 1, 2017Updated 8 years ago
- Go implementation of the FastCDC content-defined chunking algorithm☆82Aug 14, 2023Updated 2 years ago
- ☆12Sep 18, 2023Updated 2 years ago
- C++11 library for fast fuzzy searching☆15Jun 9, 2015Updated 10 years ago
- Semantic Versioning Library☆12Updated this week
- Java and Scala client libraries for Concord☆13Feb 15, 2017Updated 9 years ago
- A repl for the D programming language☆32Oct 1, 2020Updated 5 years ago
- CSS library for D☆11Dec 1, 2016Updated 9 years ago
- The way to program - Let's think like a D(eveloper) book☆12Feb 24, 2016Updated 10 years ago
- [ARCHIVED] JavaScript implementation of the layout and chunking mechanisms used by IPFS☆22Aug 12, 2020Updated 5 years ago
- A simple utility to generate real File and Active Directory activity in lab environments for the purposes of monitoring changes and detec…☆11Dec 4, 2018Updated 7 years ago
- Fork of edx-theme repository customized for gymnasium☆10Apr 14, 2021Updated 4 years ago
- Javascript Interpreter in Functional-Style Javascript☆20Feb 9, 2018Updated 8 years ago
- Java off-heap byte array to long cache with FIFO eviction semantics.☆10Jan 13, 2017Updated 9 years ago
- Apple Audio File Play wrapper for Node.js☆13May 19, 2023Updated 2 years ago
- Efficient sets of bytes for Rust☆18Jun 23, 2020Updated 5 years ago
- Proof of concept demo for using HTML fragments as a transfer format between the client and server.☆20Jan 24, 2023Updated 3 years ago
- Stream processing pipelines in D☆14Feb 17, 2017Updated 9 years ago
- firewall.js creates an `<iframe>` that blocks networking and downloading☆13Feb 9, 2026Updated last month
- Spring Cloud Zuul Trie tree route matcher☆14Feb 1, 2016Updated 10 years ago
- ☆18May 28, 2016Updated 9 years ago
- Battery impulse counter based on PTVO Zigbee firmware with CC2530 and PCF8583 acting as hardware counter☆15Feb 1, 2025Updated last year
- With this plugin, you can use jenkins build artifact as a repository, and deploy your build artifact with capistrano.☆32Jun 17, 2020Updated 5 years ago
- ☆30Jan 15, 2020Updated 6 years ago
- WASM/JS clone of wabt's wat2wasm☆29Apr 5, 2022Updated 3 years ago
- Deduplication Based Filesystem☆389Jul 5, 2023Updated 2 years ago
- rust crate to get information on mounted disks on linux and Mac☆23Dec 22, 2025Updated 3 months ago