ananthdurai / airflow-training
Airflow training for the crunch conf
☆105Updated 6 years ago
Alternatives and similar repositories for airflow-training:
Users that are interested in airflow-training are comparing it to the libraries listed below
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated 2 years ago
- ☆198Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 4 years ago
- How to build an awesome data engineering team☆99Updated 5 years ago
- Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.☆62Updated 4 years ago
- Repository used for Spark Trainings☆53Updated last year
- Great Expectations Airflow operator☆160Updated this week
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- ☆84Updated last year
- ☆25Updated last year
- ☆19Updated 3 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆32Updated 4 years ago
- Code snippets for Data Engineering Design Patterns book☆73Updated 3 weeks ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆76Updated 5 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆134Updated 4 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆161Updated 3 years ago
- Airflow basics tutorial☆397Updated 3 years ago
- Airflow ETL for Meetup API☆46Updated 6 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆170Updated last year
- Projects done in the Data Engineering Nanodegree by Udacity.com☆270Updated 5 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆172Updated 3 years ago
- Astronomer Core Docker Images☆106Updated 9 months ago
- Airflow Unit Tests and Integration Tests☆256Updated 2 years ago
- Data engineering interviews Q&A for data community by data community☆64Updated 4 years ago
- ☆22Updated 2 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- ☆38Updated 4 years ago