danielbeach / GreatExpectationsWithDatabricks
Getting Great Expectations setup to run on DataBricks with Spark Dataframes.
☆12Updated 2 years ago
Related projects: ⓘ
- Fully unit tested utility functions for data engineering. Python 3 only.☆14Updated 3 weeks ago
- Read Delta tables without any Spark☆47Updated 6 months ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆35Updated 2 months ago
- Building 3D Trusted Data Pipelines With Dagster, Dbt, and Duckdb☆18Updated last year
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 3 years ago
- ☆38Updated this week
- ☆11Updated 2 years ago
- A serverless duckDB deployment at GCP☆34Updated 2 years ago
- ☆11Updated 2 years ago
- Build your feature store with macros right within your dbt repository☆37Updated last year
- ☆12Updated last month
- Example Set up For DBT Cloud using Github Integrations☆11Updated 4 years ago
- ☆16Updated last year
- Repository containing various utils related to Snowflake migration at Faire.☆11Updated last year
- A Python API for Asynchronously Loading Data into Snowflake DB -☆59Updated last week
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- build dw with dbt☆26Updated last month
- Profiles the data, validates the schema and runs data quality checks and produces a report☆20Updated 5 years ago
- A cool simple example of functional data engineering☆32Updated last year
- ☆17Updated 2 years ago
- ☆45Updated last month
- Cost Efficient Data Pipelines with DuckDB☆42Updated last month
- Big Data Demystified meetup and blog examples☆31Updated last month
- Dask integration for Snowflake☆29Updated 2 months ago
- DuckDB SQL Tools add DuckDB support to VSCode, and provide database schema and SQL query interfaces for the popular SQLTools extension, S…☆12Updated 2 months ago
- Playing with different packages of the Apache Spark☆26Updated 3 months ago
- Fake Pandas / PySpark DataFrame creator☆35Updated 6 months ago
- ☆67Updated this week
- Unity Catalog UI☆40Updated 2 weeks ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆22Updated last year