marcosmarxm / airflow-testing-ci-workflow
(project & tutorial) dag pipeline tests + ci/cd setup
☆86Updated 4 years ago
Alternatives and similar repositories for airflow-testing-ci-workflow:
Users that are interested in airflow-testing-ci-workflow are comparing it to the libraries listed below
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated 2 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆161Updated 3 years ago
- Great Expectations Airflow operator☆160Updated this week
- Execution of DBT models using Apache Airflow through Docker Compose☆114Updated 2 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.☆62Updated 4 years ago
- Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase☆124Updated 2 years ago
- ☆19Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- ☆38Updated 4 years ago
- A curated collection of publicly available resources on dbt best practices and how data-driven organizations around the world utilize dbt☆113Updated 3 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆170Updated last year
- Code for dbt tutorial☆151Updated 9 months ago
- Creates a Simulation of Fake Web Events☆84Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆73Updated 3 weeks ago
- Project for "Data pipeline design patterns" blog.☆44Updated 6 months ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- ☆53Updated last month
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆127Updated 7 months ago
- A complete development environment setup for working with Airflow☆127Updated 2 years ago
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆192Updated 3 weeks ago
- Example repo to create end to end tests for data pipeline.☆22Updated 8 months ago
- Weekly Data Engineering Newsletter☆94Updated 7 months ago
- ☆198Updated last year
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- ☆74Updated 4 months ago
- Airflow ETL for Meetup API☆46Updated 6 years ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 6 months ago