jw-ng / airflow-dynamic-dags

Related projects ⓘ

Alternatives and complementary repositories for airflow-dynamic-dags

• hnawaz007 / dbt-dw
  build dw with dbt
  ☆29Updated 2 weeks ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• dbt-labs / dbt-starter-project
  Cloned by the `dbt init` task
  ☆59Updated 6 months ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆73Updated 5 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆143Updated 5 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 4 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆205Updated last month
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆88Updated last year
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆58Updated last year
• ongxuanhong / de03-trino-dbt-spark-everything-everywhere-all-at-once
  ☆14Updated 8 months ago
• jamesshocking / Spark-REST-API-UDF
  Example of how to leverage Apache Spark distributed capabilities to call REST-API using a UDF
  ☆49Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆27Updated 3 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• dbt-labs / dbt-python-hands-on-lab-snowpark
  ☆16Updated 3 months ago
• skhatri / airflow-by-example
  Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes maste…
  ☆22Updated 2 years ago
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆191Updated this week
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆41Updated 3 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆112Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆37Updated 4 months ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆44Updated 2 years ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆25Updated 8 months ago
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆15Updated 3 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆38Updated this week
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆109Updated 3 months ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆61Updated last month
• Beam-College / season-2022
  ☆36Updated 2 years ago
• astronomer / airflow-covid-data
  Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.
  ☆16Updated 3 years ago
• astronomer / cosmos-demo
  Demo DAGs that show how to run dbt Core in Airflow using Cosmos
  ☆36Updated last month