Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
☆291Jun 11, 2023Updated 2 years ago
Alternatives and similar repositories for LSH
Users that are interested in LSH are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW☆2,916Apr 18, 2026Updated last month
- Example Python code for comparing documents using MinHash☆252Feb 11, 2019Updated 7 years ago
- A pure python implementation of locality sensitive hashing for text documents☆87Oct 24, 2015Updated 10 years ago
- A Locality Sensitive Hashing (LSH) library with an emphasis on large, highly-dimensional datasets.☆150Sep 4, 2024Updated last year
- ☆32Nov 15, 2017Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Cross-domain temporal information extractors: temporal expressions, events and temporal links.☆21Oct 29, 2015Updated 10 years ago
- Simhash and near-duplicate detection☆423May 15, 2023Updated 3 years ago
- SuperMinHash: A New Minwise Hashing Algorithm for Jaccard Similarity Estimation, Simhash and SimhashIndex☆19Nov 18, 2022Updated 3 years ago
- Weighted MinHash implementation on CUDA (multi-gpu).☆122Nov 29, 2023Updated 2 years ago
- ☆13Feb 11, 2019Updated 7 years ago
- Fast fuzzy text search☆12May 16, 2023Updated 3 years ago
- Simhashing in C++☆136Feb 14, 2023Updated 3 years ago
- Python wrapper for a C++ Double Metaphone☆15Jan 12, 2026Updated 4 months ago
- Python API for Various DB-Backed Simhash Clusters☆64Mar 16, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Locality Sensitive Hashing for semantic similarity (Python 3.x)☆15Jun 8, 2018Updated 7 years ago
- Web content extraction using machine learning☆34Mar 3, 2021Updated 5 years ago
- Collection of some algorithms for entity resolution☆28Sep 7, 2015Updated 10 years ago
- Locality-sensitive hashing algorithm for text similarity comparisons☆58Apr 9, 2025Updated last year
- Materials for the Neural Network tutorial at PyData NYC 2019☆15Feb 15, 2023Updated 3 years ago
- Python framework for fast (approximated) nearest neighbour search in large, high-dimensional data sets using different locality-sensitive…☆772Feb 23, 2023Updated 3 years ago
- Locality Sensitive Hashing☆80Jul 12, 2023Updated 2 years ago
- Neural LSH [ICLR 2020] - Using supervised learning to produce better space partitions for fast nearest neighbor search.☆73Jan 20, 2021Updated 5 years ago
- a python library for parsing unstructured western names into name components.☆618May 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Detecting near duplicates usign Moses Charikars Algorithm☆20Apr 27, 2026Updated 3 weeks ago
- All-pair set similarity search on millions of sets in Python and on a laptop☆604Oct 11, 2022Updated 3 years ago
- A Python Implementation of Simhash Algorithm☆1,037Mar 24, 2022Updated 4 years ago
- Python wrapper around SVDLIBC, a fast library for sparse Singular Value Decomposition☆55Aug 16, 2013Updated 12 years ago
- A maximum-strength name parser for record linkage.☆40Sep 3, 2025Updated 8 months ago
- Extractive and Compressive Neural Summarization Based on Summary State Representations (NAACL 2019)☆16May 12, 2020Updated 6 years ago
- The pipeline for the OSCAR corpus☆177Nov 9, 2025Updated 6 months ago
- Pretrained Biomedical Name Encoder☆15Jul 28, 2019Updated 6 years ago
- A simple tool for small scale experiments using bayesian optimization☆35Aug 14, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Parallel Semi-Supervised Latent Dirichlet Allocation☆33Jan 21, 2022Updated 4 years ago
- A Cython implementation of the affine gap string distance☆57Jan 23, 2023Updated 3 years ago
- Search 'from' and 'to' strings to learn a text cleaning mapping☆17Aug 29, 2015Updated 10 years ago
- Scalable String Similarity Joins in Python☆38Jul 12, 2024Updated last year
- Slides and scripts from Data in Bahia meetups☆13Dec 8, 2022Updated 3 years ago
- LSHDB is a parallel and distributed data engine, which relies on Locality-Sensitive Hashing and noSQL systems, for performing record link…☆34Aug 30, 2022Updated 3 years ago
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,048Feb 21, 2024Updated 2 years ago