A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
☆4,438Jul 29, 2025Updated 7 months ago
Alternatives and similar repositories for dedupe
Users that are interested in dedupe are comparing it to the libraries listed below
Sorting:
- Examples for using the dedupe library☆419Aug 10, 2024Updated last year
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,046Feb 21, 2024Updated 2 years ago
- Command line tool for deduplicating CSV files☆434Mar 31, 2020Updated 5 years ago
- A list of free data matching and record linkage software.☆401Feb 21, 2024Updated 2 years ago
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,980Updated this week
- a python library for parsing unstructured western names into name components.☆616May 15, 2025Updated 9 months ago
- A toolkit for making domain-specific probabilistic parsers☆806Sep 26, 2024Updated last year
- Fuzzy String Matching in Python☆9,270Feb 24, 2023Updated 3 years ago
- a python library for parsing unstructured United States address strings into address components☆1,616Aug 7, 2025Updated 6 months ago
- 🪼 a python library for doing approximate and phonetic matching of strings.☆2,193Dec 15, 2025Updated 2 months ago
- Scalable identity resolution, entity resolution, data mastering and deduplication using ML☆1,156Updated this week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆33,254Nov 27, 2025Updated 3 months ago
- A system for quickly generating training data with weak supervision☆5,939May 2, 2024Updated last year
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆14,359Oct 27, 2025Updated 4 months ago
- Simplifies use of the Dedupe library via Pandas☆137Mar 30, 2023Updated 2 years ago
- Always know what to expect from your data.☆11,162Feb 20, 2026Updated last week
- NLP, before and after spaCy☆2,235Sep 22, 2023Updated 2 years ago
- A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.☆10,049Sep 11, 2025Updated 5 months ago
- Duke is a fast and flexible deduplication engine written in Java☆627Oct 11, 2023Updated 2 years ago
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆14,169Oct 29, 2025Updated 4 months ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,475Feb 5, 2026Updated 3 weeks ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,681Updated this week
- A library for debugging/inspecting machine learning classifiers and explaining their predictions☆2,772Feb 10, 2026Updated 2 weeks ago
- PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolut…☆161Nov 18, 2022Updated 3 years ago
- Topic Modelling for Humans☆16,361Nov 1, 2025Updated 4 months ago
- A Python tool that automatically cleans data sets and readies them for analysis.☆1,077May 22, 2019Updated 6 years ago
- An open source python library for automated feature engineering☆7,614Feb 3, 2026Updated 3 weeks ago
- 📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.☆3,517Apr 18, 2025Updated 10 months ago
- Parallel computing with task scheduling☆13,746Feb 22, 2026Updated last week
- Declarative visualization library for Python☆10,276Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,362Feb 10, 2026Updated 2 weeks ago
- Python package for performing Entity and Text Matching using Deep Learning.☆614Jun 18, 2024Updated last year
- Extract Keywords from sentence or Replace keywords in sentences.☆5,708Apr 13, 2025Updated 10 months ago
- Visual analysis and diagnostic tools to facilitate machine learning model selection.☆4,395Feb 19, 2025Updated last year
- the portable Python dataframe library☆6,417Updated this week
- Python implementation of TextRank algorithms ("textgraphs") for phrase extraction☆2,209Feb 15, 2026Updated 2 weeks ago
- Resources for tackling record linkage / deduplication / data matching problems☆126Feb 22, 2024Updated 2 years ago
- Rapid fuzzy string matching in Python using various string metrics☆3,740Jan 26, 2026Updated last month
- Lime: Explaining the predictions of any machine learning classifier☆12,101Jul 25, 2024Updated last year