ananthdurai / airflow-training
Airflow training for the crunch conf
☆105Updated 6 years ago
Alternatives and similar repositories for airflow-training:
Users that are interested in airflow-training are comparing it to the libraries listed below
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 4 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated 2 years ago
- ☆198Updated last year
- How to build an awesome data engineering team☆100Updated 5 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.☆63Updated 4 years ago
- Repository used for Spark Trainings☆53Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆134Updated 4 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆337Updated 6 years ago
- Airflow Unit Tests and Integration Tests☆256Updated 2 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆171Updated last year
- Great Expectations Airflow operator☆161Updated last week
- Data pipeline with dbt, Airflow, Great Expectations☆161Updated 3 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- Code snippets for Data Engineering Design Patterns book☆75Updated 2 weeks ago
- ☆25Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆116Updated 2 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- ☆84Updated 2 years ago
- Airflow basics tutorial☆397Updated 3 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Updated last year
- The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.☆248Updated 3 years ago
- A complete development environment setup for working with Airflow☆128Updated 2 years ago
- ☆38Updated 4 years ago
- Apache Airflow integration for dbt☆401Updated 10 months ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆33Updated 4 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Astronomer Core Docker Images☆106Updated 10 months ago