ananthdurai / airflow-training

Related projects ⓘ

Alternatives and complementary repositories for airflow-training

• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆85Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• alexandraabbas / apache-airflow-course
  Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.
  ☆62Updated 4 years ago
• danielvdende / data-testing-with-airflow
  ☆196Updated last year
• natbusa / data-engineering
  How to build an awesome data engineering team
  ☆99Updated 5 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated last year
• monte-carlo-data / data-downtime-challenge
  ☆83Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆89Updated 2 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆256Updated 2 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated last year
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆159Updated 3 weeks ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆61Updated 4 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆108Updated 4 years ago
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆333Updated 6 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• jamesbyars / apache-spark-etl-pipeline-example
  Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…
  ☆24Updated last year
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆167Updated last year
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆73Updated 5 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• Realsid / databricks-spark-certification
  Guide for databricks spark certification
  ☆58Updated 3 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆111Updated 4 months ago
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆158Updated 3 years ago
• snowflakedb / snowflake-ingest-python
  A Python API for Asynchronously Loading Data into Snowflake DB -
  ☆60Updated this week
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 4 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆92Updated 5 months ago