sodadata / soda-core
Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
β2,046Updated this week
Alternatives and similar repositories for soda-core:
Users that are interested in soda-core are comparing it to the libraries listed below
- re_data - fix data issues before your users & CEO would discover them πβ1,565Updated 10 months ago
- Efficient data transformation and modeling framework that is backwards compatible with dbt.β2,180Updated this week
- Port(ish) of Great Expectations to dbt test macrosβ1,155Updated 3 months ago
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hostβ¦β2,023Updated this week
- An Open Standard for lineage metadata collectionβ1,879Updated this week
- Dynamically generate Apache Airflow DAGs from YAML configuration filesβ1,269Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadataβ1,879Updated this week
- A curated list of awesome dbt resourcesβ1,377Updated last week
- Python API for Deequβ754Updated 5 months ago
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)β1,022Updated this week
- Utility functions for dbt projects.β1,486Updated last week
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning mβ¦β853Updated 11 months ago
- Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of codeβ886Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.β1,192Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy π οΈβ3,355Updated this week
- π Awesome Data Catalogs and Observability Platforms.β807Updated 7 months ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.β367Updated this week
- Apache Airflow integration for dbtβ400Updated 10 months ago
- List of `pre-commit` hooks to ensure the quality of your `dbt` projects.β634Updated last month
- A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineerβ¦β530Updated last week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.β3,385Updated 2 weeks ago
- Nessie: Transactional Catalog for Data Lakes with Git-like semanticsβ1,159Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewβ¦β2,055Updated 6 months ago
- Scalable identity resolution, entity resolution, data mastering and deduplication using MLβ989Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interactingβ¦β4,534Updated last week
- dbt package that is part of Elementary, the dbt-native data observability solution for data & analytics engineers. Monitor your data pipeβ¦β418Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wrβ¦β2,001Updated this week
- PySpark test helper methods with beautiful error messagesβ672Updated 2 weeks ago
- Macros that generate dbt codeβ543Updated 3 weeks ago
- Apache PyIcebergβ652Updated this week