moj-analytical-services / splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
☆1,465Updated this week
Alternatives and similar repositories for splink:
Users that are interested in splink are comparing it to the libraries listed below
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆981Updated 11 months ago
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆2,064Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆987Updated this week
- Scalable identity resolution, entity resolution, data mastering and deduplication using ML☆979Updated this week
- Repository for the ActivitySchema spec and supporting materials☆410Updated 2 years ago
- Monte Carlo simulation of the NBA season, leveraging dbt, duckdb and evidence.dev☆483Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,141Updated this week
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆862Updated last year
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,040Updated 4 months ago
- A list of free data matching and record linkage software.☆374Updated 11 months ago
- Turning PySpark Into a Universal DataFrame API☆365Updated this week
- 🦆 A curated list of awesome DuckDB resources☆1,526Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,009Updated this week
- Malloy is an experimental language for describing data relationships and transformations.☆2,055Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,536Updated this week
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆1,859Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆813Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,614Updated this week
- Making data lake work for time series☆1,152Updated 5 months ago
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,179Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,565Updated 9 months ago
- Dagster Labs' open-source data platform, built with Dagster.☆317Updated this week
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆2,022Updated this week
- Port(ish) of Great Expectations to dbt test macros☆1,137Updated last month
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆854Updated 10 months ago
- Template for a data contract used in a data mesh.☆468Updated 11 months ago
- Work with your web service, database, and streaming schemas in a single format.☆337Updated 10 months ago
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,178Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,115Updated this week
- Python Stream Processing☆1,631Updated this week