astronomer / dynamic-dags-tutorial
☆27Updated last year
Related projects ⓘ
Alternatives and complementary repositories for dynamic-dags-tutorial
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆85Updated 3 years ago
- Great Expectations Airflow operator☆159Updated 2 weeks ago
- ☆20Updated 3 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Enforce Best Practices for all your Airflow DAGs. ⭐☆89Updated this week
- Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes maste…☆22Updated 2 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆24Updated last year
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆83Updated 6 months ago
- Make simple storing test results and visualisation of these in a BI dashboard☆39Updated 3 weeks ago
- Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…☆28Updated last year
- Sample configuration to deploy a modern data platform.☆86Updated 2 years ago
- Astronomer Core Docker Images☆106Updated 5 months ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆137Updated last week
- A simple and easy to use Data Quality (DQ) tool built with Python.☆48Updated last year
- Cloned by the `dbt init` task☆59Updated 6 months ago
- Read Delta tables without any Spark☆47Updated 8 months ago
- Fake Pandas / PySpark DataFrame creator☆43Updated 8 months ago
- A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran☆20Updated 2 weeks ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆68Updated 3 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆167Updated last year
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆113Updated last year
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 2 years ago
- New generation opensource data stack☆61Updated 2 years ago
- Sample Airflow DAGs☆61Updated last year
- Data lake, data warehouse on GCP☆54Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆43Updated 3 years ago