astronomer / dag-factory
Dynamically generate Apache Airflow DAGs from YAML configuration files
☆1,158Updated last week
Related projects: ⓘ
- Guides and docs to help you get up and running with Apache Airflow.☆798Updated last year
- ETL best practices with airflow, with examples☆1,282Updated 2 years ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,652Updated 3 months ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,866Updated last week
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆395Updated this week
- Apache Airflow integration for dbt☆392Updated 4 months ago
- Utility functions for dbt projects.☆1,334Updated last week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,540Updated 4 months ago
- CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer☆348Updated this week
- Python API for Deequ☆704Updated last week
- Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code☆592Updated this week
- An Open Standard for lineage metadata collection☆1,708Updated this week
- Port(ish) of Great Expectations to dbt test macros☆1,044Updated last week
- A Helm chart to install Apache Airflow on Kubernetes☆274Updated this week
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆340Updated this week
- Curated list of resources about Apache Airflow☆3,653Updated 3 weeks ago
- PySpark test helper methods with beautiful error messages☆583Updated last week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,732Updated last week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,612Updated this week
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆461Updated this week
- A curated list of data engineering tools for software developers☆460Updated 7 years ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆624Updated last week
- dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks☆390Updated this week
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆646Updated 2 months ago
- 📙 Awesome Data Catalogs and Observability Platforms.☆677Updated last month
- A curated list of awesome dbt resources☆1,107Updated this week
- Example DAGs using hooks and operators from Airflow Plugins☆333Updated 6 years ago
- Airflow Unit Tests and Integration Tests☆254Updated last year
- This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) env…☆665Updated last month
- Code for Data Pipelines with Apache Airflow☆696Updated last month