Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.
☆19Aug 28, 2023Updated 3 years ago
Alternatives and similar repositories for deduplication
Users that are interested in deduplication are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆39Jul 28, 2023Updated 3 years ago
- Price options by fitting a Lévy distribution☆10Jan 20, 2021Updated 5 years ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- ☆14Dec 9, 2021Updated 4 years ago
- Tutorials for the geometry-central geometry processing library.☆16Jul 3, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Simple C++ Docker-Images with gcc/clang, cmake and dependency manager (conan and/or vcpkg).☆10Jan 14, 2023Updated 3 years ago
- level2-nlp-generationfornlp-nlp-05-lv3 created by GitHub Classroom☆14Jan 5, 2025Updated last year
- data related codebase for polyglot project☆19Mar 30, 2023Updated 3 years ago
- Autonomous intersection management system implemented by Virtual Platooning algorithm☆14Jul 28, 2019Updated 7 years ago
- 나무위키, 위키피디아, 다음블로그, 티스토리, 유튜브, 네이트판 크롤러☆13Feb 20, 2026Updated 7 months ago
- A blazing fast lightweight static compile time 2D, 3D, and N-dimensional C++20 vector library.☆25Dec 12, 2023Updated 2 years ago
- Functional composable pipelines allowing clean separation of the business logic and its implementation☆11Sep 6, 2025Updated last year
- Copilot with deepseek and more...☆13Mar 7, 2025Updated last year
- TensorRT☆11Sep 22, 2020Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Visualise path finding algorithms on a hexagonal grid.☆16Sep 13, 2026Updated 3 weeks ago
- A python library / model for creating co-references between AMR graph nodes.☆11Dec 11, 2022Updated 3 years ago
- An in-memory point-in-polygon (reverse geocoding) package for Who's On First data☆10Sep 28, 2017Updated 9 years ago
- a rust library to find near-duplicate video files☆25Apr 23, 2025Updated last year
- RAG-Fusion implementation using Langchain, Weaviate and OpenAI☆13Oct 31, 2023Updated 2 years ago
- A program to simulate retirement investent and give recommendations using Monte-Carlo simulation techniques☆21Aug 6, 2023Updated 3 years ago
- ☆15Sep 12, 2026Updated 3 weeks ago
- A content inspecting SMTP proxy☆17Jun 9, 2014Updated 12 years ago
- Ongoing research training Mixture of Expert models.☆21Sep 16, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆16Nov 19, 2023Updated 2 years ago
- A Go(lang) IDS rule parser☆13Jun 10, 2019Updated 7 years ago
- ☆14Aug 24, 2026Updated last month
- Dockerized Python microservice with REST API for verbs conjugation in French, Spanish and Portuguese☆25Apr 21, 2026Updated 5 months ago
- IEEE-CIS Fraud Detection Kaggle Competition Code☆11Oct 3, 2019Updated 7 years ago
- The program can be used to scrape the content from an article from web by an input of a set of URLs in a text file or a URL. This project…☆19Aug 5, 2020Updated 6 years ago
- Customize the background image in the main Anki screen as well as replace the gear icon with an image☆29Dec 17, 2025Updated 9 months ago
- A collection of selected of models built with AllenNLP.☆26Feb 20, 2020Updated 6 years ago
- VulnWhisperer Stack (ELK + VulnWhisperer + OpenVAS + Nessus)☆13Aug 14, 2018Updated 8 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆18Jun 10, 2026Updated 4 months ago
- ☆12Mar 28, 2025Updated last year
- Crawl APP data from Google Play Store in Indonesia☆24Jul 23, 2018Updated 8 years ago
- Using FasterTransformer for accelerating the predict speed of bert and roberta☆14Sep 20, 2019Updated 7 years ago
- Library for spline manipulation.☆29Jun 16, 2023Updated 3 years ago
- Repo used to share the demos from the "Seeking SRE" (O'Reilly Media, 2018) used in D.C. Vienna 2017☆14Sep 27, 2017Updated 9 years ago
- ☆39Jul 25, 2024Updated 2 years ago