Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
☆75Mar 1, 2020Updated 6 years ago
Alternatives and similar repositories for deduplication
Users that are interested in deduplication are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FastCDC implementation in Python https://pypi.org/project/fastcdc/☆65Jun 27, 2024Updated last year
- Implementation of Content Defined Chunking (CDC) in Go☆350Oct 1, 2023Updated 2 years ago
- ☆17Nov 27, 2018Updated 7 years ago
- An experiment with immutable.js-backed tcomb types☆14Jul 12, 2016Updated 9 years ago
- A fast C++ dynamic_cast<> alternative.☆33Mar 27, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- IODA: A Host/Device Co-Design for Strong Predictability Contract on Modern Flash Storage (SOSP'21)☆11Aug 23, 2021Updated 4 years ago
- ☆21Sep 16, 2016Updated 9 years ago
- Sharing scientific papers using ipfs☆14May 1, 2025Updated last year
- Rolling Hash C++ Library☆188Mar 14, 2024Updated 2 years ago
- Just a wrap over dlang std.json☆11Mar 27, 2023Updated 3 years ago
- D Text User Interface library☆12Jun 28, 2019Updated 6 years ago
- V8 for Lua☆13Oct 18, 2014Updated 11 years ago
- Constant-time hex and base64 codecs from libsodium reimplemented in Rust.☆18Apr 12, 2026Updated last month
- A library for performing Content-Defined Chunking (CDC) on data streams.☆26Mar 8, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Range Optimized Adaptive Radix Tree☆25Feb 1, 2023Updated 3 years ago
- Simplistic toy editor for D. Failed and abandoned, use anything else instead!☆16Aug 10, 2017Updated 8 years ago
- Assume License: Boost☆12Aug 1, 2017Updated 8 years ago
- Go implementation of the FastCDC content-defined chunking algorithm☆82Aug 14, 2023Updated 2 years ago
- ☆12Sep 18, 2023Updated 2 years ago
- Datalog query engine for PouchDB.☆24Jul 6, 2015Updated 10 years ago
- Window creational toolkit, cross platform. Written in D.☆16Jun 20, 2015Updated 10 years ago
- Semantic Versioning Library☆13Updated this week
- Java and Scala client libraries for Concord☆13Feb 15, 2017Updated 9 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- John Shutt's "Kernel" language implemented on ABE (C) runtime.☆13Sep 3, 2018Updated 7 years ago
- A compiler and runtime library for an extended dialect of C that checks type, memory, and concurrency safety☆16Jan 31, 2016Updated 10 years ago
- My unofficial picat http://picat-lang.org/ repository☆31Jan 11, 2024Updated 2 years ago
- Monitor fs events and reload docker-compose on changes☆19Aug 5, 2015Updated 10 years ago
- Create a single-file cross-platform server within an executable ZIP, powered by redbean 🦞☆18Dec 5, 2023Updated 2 years ago
- Linux kernel module to provide access to tcp secrets via /proc/tcp_secrets☆15Apr 5, 2021Updated 5 years ago
- A tool that enables files to be compiled into an executable and extracted at startup.☆13Dec 15, 2016Updated 9 years ago
- Javascript Interpreter in Functional-Style Javascript☆20Feb 9, 2018Updated 8 years ago
- Java off-heap byte array to long cache with FIFO eviction semantics.☆10Jan 13, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Apple Audio File Play wrapper for Node.js☆13May 19, 2023Updated 3 years ago
- ☆28Aug 4, 2016Updated 9 years ago
- Representation of JavaScript primitives as a Buffer such that binary order matches natural order of primitives☆12Jan 2, 2026Updated 4 months ago
- No Language Left Unlocked: scalable backtranslation of NLLB models☆14Aug 4, 2025Updated 9 months ago
- Generalized version of the Speck cipher for integer obfuscation☆10Sep 16, 2024Updated last year
- Transactional, replicable document store for Node.js and browsers. Built on LevelDB.☆10Aug 18, 2015Updated 10 years ago
- Proof of concept demo for using HTML fragments as a transfer format between the client and server.☆20Jan 24, 2023Updated 3 years ago