Go implementation of the FastCDC content-defined chunking algorithm
☆82Aug 14, 2023Updated 2 years ago
Alternatives and similar repositories for fastcdc-go
Users that are interested in fastcdc-go are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This package implements the FastCDC content defined chunking algorithm☆31Sep 30, 2020Updated 5 years ago
- Implementation of Content Defined Chunking (CDC) in Go☆348Oct 1, 2023Updated 2 years ago
- JotFS, a content-defined deduplicating file store☆20Feb 25, 2023Updated 3 years ago
- FastCDC implementation in Rust☆186Feb 21, 2026Updated last month
- A Golang package that implements CDC chunkers with a generic interface☆121Jan 22, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Exposes batch message receives (recvmmsg)☆14Aug 15, 2025Updated 7 months ago
- String deduplication package for Go☆19Jan 10, 2024Updated 2 years ago
- A Go library implementing a buzhash rolling hash function☆31Aug 16, 2016Updated 9 years ago
- Streaming Deduplication Package for Go☆198Nov 15, 2018Updated 7 years ago
- FastCDC implementation in Python https://pypi.org/project/fastcdc/☆63Jun 27, 2024Updated last year
- An ADL IPLD prime node that wraps go-codec-dagpb's implementation of protobuf to enable pathing☆14Feb 23, 2026Updated last month
- Rabin fingerprinting and deduplication library in C☆28Feb 16, 2016Updated 10 years ago
- Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.☆19Aug 28, 2023Updated 2 years ago
- Implementation of some rolling hashes in go☆68Sep 15, 2025Updated 6 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ssh wish middleware for sending and receiving files from familiar tools (rsync, scp, sftp)☆26Apr 4, 2025Updated 11 months ago
- Package buf-readerat implements buffered io.ReaderAt. It wraps an io.ReaderAt object, creating another io.ReaderAt object that also imple…☆20Jan 8, 2024Updated 2 years ago
- rand64 is a Go package that provides several pseudo random number generators yielding unsinged 64 bits numbers in the range [0, 1<<64)☆10Jun 9, 2019Updated 6 years ago
- 🚗 🚙 🚕 Chunking for CAR files. Split a single CAR into multiple CARs.☆14Sep 30, 2023Updated 2 years ago
- Assembly-optimized MD4 hash algorithm in Go☆18Feb 9, 2024Updated 2 years ago
- Golang fanotify example☆25Feb 29, 2024Updated 2 years ago
- A Python tool to search for and remove duplicated files in messy datasets☆16Dec 23, 2024Updated last year
- Another wasm interpreter engine for gophers based on pure golang☆11Apr 22, 2022Updated 3 years ago
- Mounts as file descriptors are useful☆13May 21, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Reflink file copy in Go☆38Mar 18, 2025Updated last year
- ☆14Mar 18, 2025Updated last year
- 文档去重功能是为了解决搜索引擎的文档语义重复的问题，方法是多重哈希下的语义指纹算法。☆12Aug 17, 2013Updated 12 years ago
- ☆16Sep 5, 2020Updated 5 years ago
- Linux kernel images for router7☆13Mar 20, 2026Updated last week
- Authenticated encryption for streams in Go☆30Dec 18, 2023Updated 2 years ago
- SkeletonDB is a lock-less thread safe in memory MVCC store written in Go.☆23Dec 13, 2016Updated 9 years ago
- Raft Autopilot☆22Nov 9, 2025Updated 4 months ago
- ☆17Feb 5, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Find duplicate text files.☆15Jan 14, 2025Updated last year
- Pure Go implementation of librsync/rdiff☆34Dec 25, 2025Updated 3 months ago
- A very useful Golang library used for working with describing time.Duration.☆16Sep 15, 2022Updated 3 years ago
- automatically trigger a profile in your golang (go) application when a condition is matched.☆15Oct 2, 2020Updated 5 years ago
- containerd meets ipfs to distribute content☆56Oct 17, 2020Updated 5 years ago
- go-ipfs-chunkers provides Splitter implementations for data before being ingested to IPFS☆30Jun 14, 2023Updated 2 years ago
- Name Service Switch (NSS) lookups with custom commands☆13Aug 14, 2025Updated 7 months ago