Resources for tackling record linkage / deduplication / data matching problems
☆126Feb 22, 2024Updated 2 years ago
Alternatives and similar repositories for record-linkage-resources
Users that are interested in record-linkage-resources are comparing it to the libraries listed below
Sorting:
- A list of free data matching and record linkage software.☆401Feb 21, 2024Updated 2 years ago
- Record Linkage ToolKit (Find and link entities)☆111Aug 14, 2023Updated 2 years ago
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,046Feb 21, 2024Updated 2 years ago
- Python implementation of anonymous linkage using cryptographic linkage keys☆70May 18, 2024Updated last year
- A browser user interface for manual labeling of record pairs.☆48Jun 23, 2023Updated 2 years ago
- An open source, high scalability toolkit in Java for Entity Resolution.☆222Jul 12, 2025Updated 7 months ago
- PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolut…☆161Nov 18, 2022Updated 3 years ago
- Probabilistic/machine-learning algorithms for medical record linkage [Critical Juncture]☆14Oct 6, 2017Updated 8 years ago
- A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.☆4,440Jul 29, 2025Updated 7 months ago
- This repository contains CROW, the Clerical Resolution Online Widget, an open-source project designed to help data linkers with their cle…☆11Feb 20, 2026Updated last week
- Minoan ER is an Entity Resolution (ER) framework, built by researchers in Crete (the land of the ancient Minoan civilization). Entity res…☆17Nov 18, 2020Updated 5 years ago
- Interactive notebooks containing demonstration code of the splink library☆40Updated this week
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,980Updated this week
- Perform Bayesian record linkage with a one-to-one matching assumption.☆11Jul 9, 2020Updated 5 years ago
- ☆10Dec 13, 2014Updated 11 years ago
- Blocking records for record linkage and data deduplication based on ANN algorithms in Python.☆19Nov 28, 2025Updated 3 months ago
- A simple library for loading word2vec binary model.☆12Sep 17, 2015Updated 10 years ago
- Author Name Disambiguation☆10Sep 10, 2021Updated 4 years ago
- Python package for performing Entity and Text Matching using Deep Learning.☆614Jun 18, 2024Updated last year
- R package fastLink: Fast Probabilistic Record Linkage☆289Dec 26, 2023Updated 2 years ago
- This project focuses on DeepER, a deep learning framework for entity resolution (record deduplication). It examines how DeepER performs o…☆47May 11, 2018Updated 7 years ago
- Probabilistic Entity Matching in Python☆13Apr 5, 2017Updated 8 years ago
- WIP on a go library for Google's Operational Research Tools☆11Jul 6, 2023Updated 2 years ago
- ☆14Jan 21, 2023Updated 3 years ago
- An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.☆89Nov 3, 2025Updated 4 months ago
- Convert any image into a Region Adjacency Graph (RAG)☆12Apr 27, 2020Updated 5 years ago
- Record linking package that fuzzy matches two Python pandas dataframes using sqlite3 fts4☆286Aug 9, 2022Updated 3 years ago
- Golang implementation of the Linear Programming (LP) Simplex algorithm☆11Sep 27, 2019Updated 6 years ago
- Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant☆12Jan 9, 2023Updated 3 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆17Dec 15, 2025Updated 2 months ago
- ☆21Dec 19, 2019Updated 6 years ago
- Record matching and entity resolution at scale in Spark☆36Oct 31, 2023Updated 2 years ago
- SparkER: an Entity Resolution framework for Apache Spark☆65Mar 29, 2024Updated last year
- Link Wikidata items to large catalogs☆96Updated this week
- Prodigy thing(z)☆13Mar 22, 2018Updated 7 years ago
- LEMON: Explainable Entity Matching☆19Apr 6, 2022Updated 3 years ago
- A CLI to build linked data cubes.☆11Jul 10, 2025Updated 7 months ago
- Avecado (pronounced "a*vec*ado") is a library for building Mapnik vector tiles, along with language bindings for Python and some utility …☆48May 19, 2015Updated 10 years ago
- Data and code for the experiments in the Outlier Detection task proposed by Camacho-Collados et al.☆13Aug 28, 2018Updated 7 years ago