Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.
☆19Aug 28, 2023Updated 3 years ago
Alternatives and similar repositories for deduplication
Users that are interested in deduplication are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Image Deduplication in Python☆23May 16, 2020Updated 6 years ago
- Price options by fitting a Lévy distribution☆10Jan 20, 2021Updated 5 years ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- Simple Todo application in Leptos containing a CRUD elements and a popup window for items☆12Nov 27, 2025Updated 11 months ago
- Crawling some e-commerce site in Indonesia (blibli, bukalapak, lazada, mataharimall, and tokopedia) using python scrapy and save the craw…☆10Jan 28, 2017Updated 9 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆14Dec 9, 2021Updated 4 years ago
- A compact, modular C++ library for Customizable Contraction Hierarchies.☆11Feb 13, 2024Updated 2 years ago
- Tutorials for the geometry-central geometry processing library.☆15Jul 3, 2020Updated 6 years ago
- data related codebase for polyglot project☆19Mar 30, 2023Updated 3 years ago
- Beyond LM: How can language model go forward in the future?☆15Apr 30, 2023Updated 3 years ago
- Searx Metasearch Engine on Alpine Linux + S6 + Python3☆14Jul 7, 2019Updated 7 years ago
- 🚀 High-performance Rust visualization library for Leptos v0.8 with WebGPU acceleration. Achieves 20fps+ for 100K points with type-safe c…☆18Sep 26, 2025Updated last year
- 나무위키, 위키피디아, 다음블로그, 티스토리, 유튜브, 네이트판 크롤러☆13Feb 20, 2026Updated 8 months ago
- Docker configuration for davos☆14Nov 21, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation of A* Planning Algorithm in 3D Environment☆13Oct 18, 2017Updated 9 years ago
- TensorRT☆11Sep 22, 2020Updated 6 years ago
- Disables proca, Vaultkeeper and auto-reflash of stock recovery on Samsung Pie devices, including S10, N10, A10 - A50 and Tab A 10.1.☆14Apr 30, 2021Updated 5 years ago
- Scripts to build openrisc toolchain and bootable filesystem☆12Sep 15, 2014Updated 12 years ago
- A blazing fast lightweight static compile time 2D, 3D, and N-dimensional C++20 vector library.☆25Dec 12, 2023Updated 2 years ago
- Functional composable pipelines allowing clean separation of the business logic and its implementation☆11Sep 6, 2025Updated last year
- AI planning & reasoning library for Rust☆22Sep 21, 2026Updated last month
- Autonomous intersection management system implemented by Virtual Platooning algorithm☆14Jul 28, 2019Updated 7 years ago
- Python package for deduplication/entity resolution using active learning☆83Aug 24, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆19Jul 16, 2023Updated 3 years ago
- PostgreSQL database and a corresponding Flask web interface to store music library information dynamically with multiple linked versions …☆10Jun 2, 2023Updated 3 years ago
- PythonRoboticsPaper☆18Sep 3, 2018Updated 8 years ago
- "Simple Event-Driven Microservice Architecture in Rust" is an open-source project showcasing the simplicity and efficiency of building mi…☆22Dec 17, 2023Updated 2 years ago
- A python library / model for creating co-references between AMR graph nodes.☆11Dec 11, 2022Updated 3 years ago
- The program can be used to scrape the content from an article from web by an input of a set of URLs in a text file or a URL. This project…☆19Aug 5, 2020Updated 6 years ago
- PHP bindings to the Augeas API☆13Apr 28, 2016Updated 10 years ago
- A type decoder for objective c types☆14Oct 20, 2024Updated 2 years ago
- You can create datasets from Wikia/Wikipedia that can be used for entity recognition and Entity Linking. Dumps for ja-wiki and VTuber-wik…☆18May 2, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Unofficial Svelte Component Library for the UIkit framework☆11Dec 7, 2021Updated 4 years ago
- ☆14Oct 22, 2026Updated last week
- A program to simulate retirement investent and give recommendations using Monte-Carlo simulation techniques☆21Aug 6, 2023Updated 3 years ago
- Repo for the IDESSAI 2024 course on modeling audio with discrete tokens.☆13Sep 13, 2024Updated 2 years ago
- VG-AMRCoref model.☆12Mar 5, 2022Updated 4 years ago
- MyAssistant Playground --powered by Bedrock Claude & AutoGen☆12Mar 26, 2024Updated 2 years ago
- ☆12Mar 28, 2025Updated last year