Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
☆75Mar 1, 2020Updated 6 years ago
Alternatives and similar repositories for deduplication
Users that are interested in deduplication are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FastCDC implementation in Python https://pypi.org/project/fastcdc/☆65Jun 27, 2024Updated last year
- An experiment with immutable.js-backed tcomb types☆14Jul 12, 2016Updated 9 years ago
- Sharing scientific papers using ipfs☆14May 1, 2025Updated last year
- Just a wrap over dlang std.json☆11Mar 27, 2023Updated 3 years ago
- D Text User Interface library☆12Jun 28, 2019Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Constant-time hex and base64 codecs from libsodium reimplemented in Rust.☆18Jun 1, 2026Updated last week
- Automatically exported from code.google.com/p/servuino☆11Oct 8, 2018Updated 7 years ago
- Simplistic toy editor for D. Failed and abandoned, use anything else instead!☆16Aug 10, 2017Updated 8 years ago
- Assume License: Boost☆12Aug 1, 2017Updated 8 years ago
- ☆12Sep 18, 2023Updated 2 years ago
- Datalog query engine for PouchDB.☆24Jul 6, 2015Updated 10 years ago
- The library handling things related to UTF-8 and Unicode when you want to port your program to Windows☆16Jan 13, 2017Updated 9 years ago
- A Rust user-space file system [WIP]☆29Jul 30, 2021Updated 4 years ago
- A repl for the D programming language☆32Oct 1, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- D stats/benchmarks and historic results☆13Sep 4, 2019Updated 6 years ago
- My unofficial picat http://picat-lang.org/ repository☆32Jan 11, 2024Updated 2 years ago
- Compiles (La)TeX code to responsive SVGs☆11Apr 28, 2023Updated 3 years ago
- CSS library for D☆11Dec 1, 2016Updated 9 years ago
- make dynamic and arbitrary breakpoint in your nginx lua code and inspect the info☆18Dec 18, 2023Updated 2 years ago
- The way to program - Let's think like a D(eveloper) book☆12Feb 24, 2016Updated 10 years ago
- Monitor fs events and reload docker-compose on changes☆19Aug 5, 2015Updated 10 years ago
- Apple Audio File Play wrapper for Node.js☆13May 19, 2023Updated 3 years ago
- Representation of JavaScript primitives as a Buffer such that binary order matches natural order of primitives☆12Jan 2, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Unstyled Light-DOM-Only Web Components☆18May 30, 2026Updated last week
- Proof of concept demo for using HTML fragments as a transfer format between the client and server.☆20Jan 24, 2023Updated 3 years ago
- An archival and backup file system for Linux using FUSE.☆25Jan 22, 2017Updated 9 years ago
- firewall.js creates an `<iframe>` that blocks networking and downloading☆13Feb 9, 2026Updated 4 months ago
- D library for getting standard paths☆18Jan 28, 2025Updated last year
- WASM/JS clone of wabt's wat2wasm☆29Apr 5, 2022Updated 4 years ago
- rust crate to get information on mounted disks on linux and Mac☆26May 4, 2026Updated last month
- "Commit information, not traffic" - Vector–Scalar Accumulator (VSA) is a lightweight algorithmic primitive that eliminates write amplific…☆28Dec 2, 2025Updated 6 months ago
- skip32 (Skipjack for 32-bit numbers) for node☆18Jan 24, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Feb 5, 2017Updated 9 years ago
- Simple Parser Combinators in Go☆15Nov 5, 2018Updated 7 years ago
- Reduce stream data to a single value☆20Mar 7, 2014Updated 12 years ago
- A library to make detecting mounted state easier in Svelte☆11May 15, 2026Updated 3 weeks ago
- API Bindings for D☆17Jul 29, 2015Updated 10 years ago
- FORTH in Zig☆20May 8, 2026Updated last month
- node native addon for rabin fingerprinting data streams [ DEPRECATED - More info on active projects and modules at https://dat-ecosystem.…☆148Jan 6, 2022Updated 4 years ago