file deduplication in go
☆11Dec 20, 2022Updated 3 years ago
Alternatives and similar repositories for filededup
Users that are interested in filededup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Get a list of deduped files on a ZFS filesystem☆14Oct 14, 2020Updated 6 years ago
- A Python tool to search for and remove duplicated files in messy datasets☆15Dec 23, 2024Updated last year
- Deduplication for cfDNA sequencing data☆11Jul 5, 2017Updated 9 years ago
- Yet another Bittorrent filesystem based on FUSE☆18May 31, 2017Updated 9 years ago
- dump redis in json and and reload into redis using python☆19Dec 27, 2018Updated 7 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A merged read deduplication tool capable to perform merged read deduplication on single end data.☆16Sep 4, 2024Updated 2 years ago
- String deduplication package for Go☆19Jan 10, 2024Updated 2 years ago
- 文档去重功能是为了解决搜索引擎的文档语义重复的问题，方法是多重哈希下的语义指纹算法。☆12Aug 17, 2013Updated 13 years ago
- Find near-duplicate documents using minhashing implemented in Go.☆16Dec 22, 2015Updated 10 years ago
- Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.☆19Aug 28, 2023Updated 3 years ago
- A file system that can be used to compare different deduplication algorithms.☆17Jul 15, 2026Updated 3 months ago
- Find duplicate text files.☆14Jan 14, 2025Updated last year
- command line MFA manager for OSX☆10Feb 16, 2018Updated 8 years ago
- Implementation of some rolling hashes in go☆68Sep 7, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Keep ESPs synchronized on mirrored-disk systems☆11Apr 22, 2025Updated last year
- A Golang package for sending emails using SMTP, SparkPost, SendGrid and MailGun☆15Jul 29, 2023Updated 3 years ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- ☆12Jul 5, 2020Updated 6 years ago
- RapidCDC: Leveraging Duplicate Locality to Accelerate Chunking in CDC-based Deduplication Systems☆17May 25, 2020Updated 6 years ago
- Update Properties of an Active Directory User with au2mator - Self Service Portal☆12May 5, 2025Updated last year
- Python library and dashboard for hyperparameter search and model training for computer vision tasks based on PyTorch, Optuna, FiftyOne, D…☆17Jul 14, 2023Updated 3 years ago
- ✨ Epris is a JavaScript library that simplifies interface development☆26May 30, 2022Updated 4 years ago
- android native port of rsync☆14Sep 1, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a deduplication tool☆17Jul 27, 2019Updated 7 years ago
- AccumuloStorage module for Pig☆14Nov 17, 2013Updated 12 years ago
- Rabin hashing and content-defined chunking for Go☆21Sep 11, 2017Updated 9 years ago
- A small library to detect if an IP address is close to yours or another of your choosing using https://ipbase.com☆18Jul 21, 2024Updated 2 years ago
- Deploy from Github to Heroku with Hubot☆20Feb 20, 2013Updated 13 years ago
- A cross platform command-line tool to deduplicate files, fast☆52Nov 5, 2023Updated 3 years ago
- RGEN - Go (GoLang) REST code generator☆16Jul 17, 2023Updated 3 years ago
- 🕹️ Group and deduplicate concurrent tasks☆32Nov 1, 2026Updated last week
- Python port for kozakdenys/qr-code-styling☆14Aug 2, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Go library implementing a buzhash rolling hash function☆30Aug 16, 2016Updated 10 years ago
- Scan, OCR and display. Paperless office.☆14May 31, 2020Updated 6 years ago
- Collection of dockerfiles to build containers☆13Mar 19, 2018Updated 8 years ago
- ☆10May 1, 2018Updated 8 years ago
- Multiple ways of chunking for data deduplication: Fixed size chunking, Content defined chunking, and File based chunking.☆19Dec 20, 2013Updated 12 years ago
- Fast duplicate file detection library☆27Jan 5, 2017Updated 9 years ago
- An ansible role to manage systemd nspawn containers and to reach them via avahi/zeroconf☆21Aug 30, 2023Updated 3 years ago