Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
☆290Jun 11, 2023Updated 2 years ago
Alternatives and similar repositories for LSH
Users that are interested in LSH are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW☆2,928Apr 18, 2026Updated last month
- Example Python code for comparing documents using MinHash☆252Feb 11, 2019Updated 7 years ago
- A pure python implementation of locality sensitive hashing for text documents☆87Oct 24, 2015Updated 10 years ago
- A Locality Sensitive Hashing (LSH) library with an emphasis on large, highly-dimensional datasets.☆149Sep 4, 2024Updated last year
- A fast Python implementation of locality sensitive hashing.☆678Apr 30, 2020Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Clustering documents based on LSH☆14Apr 20, 2016Updated 10 years ago
- ☆32Nov 15, 2017Updated 8 years ago
- Cross-domain temporal information extractors: temporal expressions, events and temporal links.☆21Oct 29, 2015Updated 10 years ago
- Simhash and near-duplicate detection☆423May 15, 2023Updated 3 years ago
- SuperMinHash: A New Minwise Hashing Algorithm for Jaccard Similarity Estimation, Simhash and SimhashIndex☆19Nov 18, 2022Updated 3 years ago
- ☆13Feb 11, 2019Updated 7 years ago
- Fast fuzzy text search☆12May 16, 2023Updated 3 years ago
- Python wrapper for a C++ Double Metaphone☆15Jan 12, 2026Updated 4 months ago
- Locality Sensitive Hashing for semantic similarity (Python 3.x)☆15Jun 8, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Web content extraction using machine learning☆34Mar 3, 2021Updated 5 years ago
- A small utility for converting Stanford GloVe vectors to HDF5 / NumPy☆12Apr 4, 2017Updated 9 years ago
- Collection of some algorithms for entity resolution☆28Sep 7, 2015Updated 10 years ago
- Locality-sensitive hashing algorithm for text similarity comparisons☆58Apr 9, 2025Updated last year
- Materials for the Neural Network tutorial at PyData NYC 2019☆15Feb 15, 2023Updated 3 years ago
- Python framework for fast (approximated) nearest neighbour search in large, high-dimensional data sets using different locality-sensitive…☆772Feb 23, 2023Updated 3 years ago
- Neural LSH [ICLR 2020] - Using supervised learning to produce better space partitions for fast nearest neighbor search.☆73Jan 20, 2021Updated 5 years ago
- Open Source Implementation of Simhash in Python☆24Sep 14, 2017Updated 8 years ago
- A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.☆4,471Jul 29, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Web archiving utility library☆11May 5, 2026Updated last month
- Detecting near duplicates usign Moses Charikars Algorithm☆20Apr 27, 2026Updated last month
- All-pair set similarity search on millions of sets in Python and on a laptop☆603Oct 11, 2022Updated 3 years ago
- A Python Implementation of Simhash Algorithm☆1,038Mar 24, 2022Updated 4 years ago
- Python wrapper around SVDLIBC, a fast library for sparse Singular Value Decomposition☆55Aug 16, 2013Updated 12 years ago
- Extractive and Compressive Neural Summarization Based on Summary State Representations (NAACL 2019)☆16May 12, 2020Updated 6 years ago
- The pipeline for the OSCAR corpus☆178Nov 9, 2025Updated 6 months ago
- Pretrained Biomedical Name Encoder☆15Jul 28, 2019Updated 6 years ago
- A simple tool for small scale experiments using bayesian optimization☆35Aug 14, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Parallel Semi-Supervised Latent Dirichlet Allocation☆33Jan 21, 2022Updated 4 years ago
- A Cython implementation of the affine gap string distance☆57Jan 23, 2023Updated 3 years ago
- Search 'from' and 'to' strings to learn a text cleaning mapping☆17Aug 29, 2015Updated 10 years ago
- Scalable String Similarity Joins in Python☆38Jul 12, 2024Updated last year
- LSHDB is a parallel and distributed data engine, which relies on Locality-Sensitive Hashing and noSQL systems, for performing record link…☆34Aug 30, 2022Updated 3 years ago
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,051Feb 21, 2024Updated 2 years ago
- Repo for my talk at the PyData Berlin 2017 conference☆66Jul 30, 2017Updated 8 years ago