mauidude / deduperView external linksLinks
Find near-duplicate documents using minhashing implemented in Go.
☆16Dec 22, 2015Updated 10 years ago
Alternatives and similar repositories for deduper
Users that are interested in deduper are comparing it to the libraries listed below
Sorting:
- a tiny iothub, simple and useful. 轻量的 iothub，用经典的物模型简化 iot 应用开发 device-shadow, iot, iothub, job, lightweight, mqtt, mysql, shadow, sqlit…☆32May 16, 2025Updated 8 months ago
- Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.☆19Aug 28, 2023Updated 2 years ago
- Easy handling of memory-mapped files☆22Mar 28, 2014Updated 11 years ago
- Text classifier for Go, aka document categorization.☆41Nov 27, 2015Updated 10 years ago
- RapidCDC: Leveraging Duplicate Locality to Accelerate Chunking in CDC-based Deduplication Systems☆17May 25, 2020Updated 5 years ago
- ☆26Nov 9, 2016Updated 9 years ago
- A high performance lock free map type for go.☆20Apr 19, 2018Updated 7 years ago
- Python utilities for detecting textual reuse☆21Nov 1, 2015Updated 10 years ago
- Fast duplicate file detection library☆26Jan 5, 2017Updated 9 years ago
- Fuzzy text searching like Sublime Text☆26Sep 10, 2015Updated 10 years ago
- Multicore optimized in-memory data store in Go☆22Jan 27, 2016Updated 10 years ago
- Utilities for extracting and compressing tgz and zip files.☆28Updated this week
- gzip indexer for random access into compressed files☆30Jan 4, 2018Updated 8 years ago
- A simple utility to safely retrieve arbitrary files.☆65Oct 18, 2016Updated 9 years ago
- Package valuegraph produces a graph representation of any Go value.☆32Feb 15, 2018Updated 7 years ago
- Python library for a duplicate lines removal written in C++☆33Aug 11, 2025Updated 6 months ago
- 【Android 11-13】为移动热点设置静态 IP☆10Mar 5, 2024Updated last year
- Disable Target API Block☆26Oct 18, 2025Updated 3 months ago
- An implementation of Count-Min Sketch in Golang☆37Dec 3, 2024Updated last year
- Next generation linbo☆12Jan 31, 2026Updated 2 weeks ago
- ArchiveWeb.page Express!☆14Nov 1, 2024Updated last year
- ☆13Jan 5, 2023Updated 3 years ago
- This project contains simple methods to measure sample relatedness and identify potential swaps and contamination☆10Jan 8, 2016Updated 10 years ago
- GogoTV是一个在线看直播的项目☆11May 25, 2017Updated 8 years ago
- Reduce frustration, improve outcomes, and save money on Claude Code CLI, Gemini, and Codex☆21Oct 31, 2025Updated 3 months ago
- Gootool for Android☆13Jul 21, 2023Updated 2 years ago
- Stor2rrd Grafan monitoring☆12Jan 8, 2019Updated 7 years ago
- A simple shell script with wizard to get you OpenWRT for Proxmox.☆10Oct 16, 2021Updated 4 years ago
- golang package to provide lightweight internal pub/sub for goroutines☆29Jan 23, 2014Updated 12 years ago
- Acode - powerful text/code editor for android☆28Updated this week
- personal synchronization application - based on git☆17Apr 6, 2012Updated 13 years ago
- C++ rewrite of PPPwn (PlayStation 4 PPPoE RCE)☆10Feb 27, 2025Updated 11 months ago
- Dedup and compress your device mapper devices. Works especially well with thin provisioning.☆10Dec 4, 2025Updated 2 months ago
- [WLLS]基于微信小程序开发所需的前后端需求，搭建以laravel，lavas，微信小程序基础代码为基线的平台☆10Jun 10, 2018Updated 7 years ago
- vertical search crawler☆38Jan 9, 2012Updated 14 years ago
- A Go library for specialized integer hash maps.☆11Sep 15, 2016Updated 9 years ago
- collection of modules to build distributed and reliable concurrent systems in Python.☆206Sep 14, 2013Updated 12 years ago
- 一个类似llama_index的极简GO版本框架(Qdrant + embedding + openai + gin)，本地知识库QA应用后端☆10Jul 12, 2024Updated last year
- csvcat☆22Feb 23, 2016Updated 9 years ago