FastCDC implementation in Python https://pypi.org/project/fastcdc/
☆64Jun 27, 2024Updated 2 years ago
Alternatives and similar repositories for fastcdc-py
Users that are interested in fastcdc-py are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast text chunking algorithms for Python☆12Oct 7, 2020Updated 5 years ago
- FastCDC implementation in Rust☆202Updated this week
- RapidCDC: Leveraging Duplicate Locality to Accelerate Chunking in CDC-based Deduplication Systems☆17May 25, 2020Updated 6 years ago
- Fast implementation of Content Defined Chunking (CDC) based on a rolling Rabin Checksum in C.☆55Oct 2, 2014Updated 11 years ago
- Multiple ways of chunking for data deduplication: Fixed size chunking, Content defined chunking, and File based chunking.☆19Dec 20, 2013Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation of Content Defined Chunking (CDC) in Go☆358Jun 27, 2026Updated 2 months ago
- [MSST '24] SAS-Cache: A Semantic-Aware Secondary Cache for LSM-based Key-Value Stores☆14Jun 3, 2024Updated 2 years ago
- A file system that can be used to compare different deduplication algorithms.☆16Jul 15, 2026Updated last month
- A merged read deduplication tool capable to perform merged read deduplication on single end data.☆14Sep 4, 2024Updated last year
- A Go library implementing a buzhash rolling hash function☆30Aug 16, 2016Updated 10 years ago
- ISCC: Command Line Tool☆17May 31, 2024Updated 2 years ago
- Experiments in Content Defined Chunking using rollsums.☆15May 31, 2021Updated 5 years ago
- A softeware for image based building modeling.☆15Nov 26, 2014Updated 11 years ago
- String deduplication package for Go☆19Jan 10, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 文档去重功能是为了解决搜索引擎的文档语义重复的问题，方法是多重哈希下的语义指纹算法。☆11Aug 17, 2013Updated 13 years ago
- ☆12Jan 12, 2024Updated 2 years ago
- Find duplicate text files.☆14Jan 14, 2025Updated last year
- A tiny static site generator, greatly inspired by Zola.☆14Aug 8, 2022Updated 4 years ago
- SRCNN论文复现☆11Aug 2, 2018Updated 8 years ago
- Rabin hashing and content-defined chunking for Go☆20Sep 11, 2017Updated 8 years ago
- Implementation of some rolling hashes in go☆68Updated this week
- This package implements the FastCDC content defined chunking algorithm☆31Aug 6, 2026Updated 3 weeks ago
- a deduplication tool☆17Jul 27, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Source code for the FAST '23 paper “MadFS: Per-File Virtualization for Userspace Persistent Memory Filesystems”☆18Mar 5, 2023Updated 3 years ago
- File integrity, in rust☆11Feb 19, 2022Updated 4 years ago
- Quartz Filters for MacOS, providing transformations to PDF files.☆16May 3, 2022Updated 4 years ago
- An algorithm used to classify the cell types from single cell rna sequence data.☆10Jan 24, 2021Updated 5 years ago
- Content Defined Chunking playground☆53Updated this week
- ☆13Jan 4, 2023Updated 3 years ago
- NATS Keys for Python☆19Mar 31, 2026Updated 5 months ago
- Tutorials For Data Analysis in Julia☆11Dec 6, 2024Updated last year
- A caching proxy of the Shotgun API☆22Jun 26, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Proof-of-concept, low-overhead, sampling CPU profiler for Python implemented using eBPF.☆18Oct 5, 2023Updated 2 years ago
- ❄️🐟 Fish completions for Nix☆13Aug 18, 2022Updated 4 years ago
- ☆13Updated this week
- template for https://cnli.me☆10Feb 27, 2025Updated last year
- ☆16May 4, 2021Updated 5 years ago
- Symbolic Liveness Analysis of real-world software building upon KLEE to detect liveness violations (e.g. infinite loop bugs)☆12Dec 16, 2021Updated 4 years ago
- A Rusty NoSQL layer over SQLite☆15Sep 6, 2022Updated 3 years ago