A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
☆4,531Jul 29, 2025Updated last year
Alternatives and similar repositories for dedupe
Users that are interested in dedupe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Examples for using the dedupe library☆417Aug 10, 2024Updated 2 years ago
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,065Feb 21, 2024Updated 2 years ago
- Command line tool for deduplicating CSV files☆433Mar 31, 2020Updated 6 years ago
- a python library for parsing unstructured western names into name components.☆624May 15, 2025Updated last year
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆2,592Nov 11, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A toolkit for making domain-specific probabilistic parsers☆813Sep 26, 2024Updated 2 years ago
- A list of free data matching and record linkage software.☆407Feb 21, 2024Updated 2 years ago
- a python library for parsing unstructured United States address strings into address components☆1,640Aug 7, 2025Updated last year
- Fuzzy String Matching in Python☆9,229Feb 24, 2023Updated 3 years ago
- 🪼 a python library for doing approximate and phonetic matching of strings.☆2,233Oct 16, 2026Updated last month
- AI based entity resolution, identity resolution, master data management and deduplication at scale for humans and agents☆1,275Nov 3, 2026Updated 2 weeks ago
- Resources for tackling record linkage / deduplication / data matching problems☆127Feb 22, 2024Updated 2 years ago
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆34,082Updated this week
- Simplifies use of the Dedupe library via Pandas☆137Mar 30, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A system for quickly generating training data with weak supervision☆6,028Oct 13, 2026Updated last month
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,793Updated this week
- PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolut…☆162Nov 18, 2022Updated 4 years ago
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆14,398Oct 19, 2026Updated last month
- Topic Modelling for Humans☆16,515Nov 1, 2025Updated last year
- NLP, before and after spaCy☆2,239Sep 22, 2023Updated 3 years ago
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆14,342Oct 29, 2025Updated last year
- Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.☆8,857Aug 5, 2026Updated 3 months ago
- Fixes mojibake and other glitches in Unicode text, after the fact.☆4,068Oct 30, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An open source python library for automated feature engineering☆7,697Sep 11, 2026Updated 2 months ago
- 📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.☆3,546Apr 18, 2025Updated last year
- Always know what to expect from your data.☆11,942Updated this week
- OpenRefine is a free, open source power tool for working with messy data and improving it☆12,117Updated this week
- A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.☆10,061Sep 11, 2025Updated last year
- An open source, high scalability toolkit in Java for Entity Resolution.☆224Jul 12, 2025Updated last year
- A Python tool that automatically cleans data sets and readies them for analysis.☆1,075May 22, 2019Updated 7 years ago
- A simple command line interface to the datamade/dedupe library.☆43Dec 26, 2022Updated 3 years ago
- MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW☆2,980Oct 26, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,518Nov 6, 2026Updated 2 weeks ago
- Extract Keywords from sentence or Replace keywords in sentences.☆5,711Apr 13, 2025Updated last year
- Python package for performing Entity and Text Matching using Deep Learning.☆623Jun 18, 2024Updated 2 years ago
- A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.☆4,926May 13, 2026Updated 6 months ago
- Visual analysis and diagnostic tools to facilitate machine learning model selection.☆4,407Feb 19, 2025Updated last year
- Modin: Scale your Pandas workflows by changing a single line of code☆10,389Feb 10, 2026Updated 9 months ago
- A suite of utilities for converting to and working with CSV, the king of tabular file formats.☆6,419Nov 9, 2026Updated last week
Are these results useful?