cleanzr / dblink
Distributed Bayesian Entity Resolution in Apache Spark
☆57Updated 3 years ago
Alternatives and similar repositories for dblink:
Users that are interested in dblink are comparing it to the libraries listed below
- An End-to-End Evaluation Framework for Entity Resolution Systems☆26Updated last year
- SparkER: an Entity Resolution framework for Apache Spark☆63Updated 10 months ago
- Record matching and entity resolution at scale in Spark☆34Updated last year
- Interactive notebooks containing demonstration code of the splink library☆37Updated last year
- A tutorial on entity resolution (record linkage or de-duplication)☆63Updated 4 years ago
- ☆15Updated 2 years ago
- Binding the GDELT universe in a Spark environment☆23Updated last year
- This project focuses on DeepER, a deep learning framework for entity resolution (record deduplication). It examines how DeepER performs o…☆46Updated 6 years ago
- Spark implementation of computing Shapley Values using monte-carlo approximation☆74Updated last year
- A browser user interface for manual labeling of record pairs.☆44Updated last year
- Performs unique entity estimation corresponding to Chen, Shrivastava, Steorts (2018).☆14Updated 6 years ago
- variations of the record linkage model of Steorts et al. AISTATS 2014's "SMERED: A Bayesian Approach to Graphical Record Linkage and De-d…☆27Updated 7 years ago
- pyspark-parallelised functions producing graph-theoretical metrics in connected component clusters for use in record-linkage (or other do…☆10Updated last year
- PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolut…☆148Updated 2 years ago
- Similarity encoding of dirty categorical variables (strings)☆20Updated 6 years ago
- Collection of some algorithms for entity resolution☆28Updated 9 years ago
- Materials for Apache Arrow workshop at VLDB 2019☆42Updated 4 years ago
- Resources for tackling record linkage / deduplication / data matching problems☆117Updated 11 months ago
- ☆28Updated 6 years ago
- List of entity resolution software and resources.☆56Updated 11 months ago
- Import Databricks notebooks as libraries/modules☆15Updated 2 years ago
- NitroML is a modular, portable, and scalable model-quality benchmarking framework for Machine Learning and Automated Machine Learning (Au…☆42Updated 3 years ago
- Notebooks configured to be run with Binder, usually found on my blog.☆42Updated last year
- this repo might get accepted☆29Updated 4 years ago
- A proposed standard `NOCK` for a Parquet format that supports efficient distributed serialization of multiple kinds of graph technologies☆19Updated 2 years ago
- ☆15Updated 5 years ago
- Data Scientist code test☆19Updated 4 years ago
- Probabilistic type inference☆29Updated 3 years ago
- Ensemble topic modelling with pLSA☆114Updated 3 years ago
- A Python package for efficient evaluation based on OASIS (Optimal Asymptotic Sequential Importance Sampling).☆15Updated 3 years ago