astronomer / dag-factory
Dynamically generate Apache Airflow DAGs from YAML configuration files
☆1,209Updated this week
Related projects ⓘ
Alternatives and complementary repositories for dag-factory
- Guides and docs to help you get up and running with Apache Airflow.☆800Updated 2 years ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,681Updated 5 months ago
- ETL best practices with airflow, with examples☆1,295Updated last month
- Apache Airflow integration for dbt☆396Updated 6 months ago
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆403Updated 2 weeks ago
- A Helm chart to install Apache Airflow on Kubernetes☆276Updated this week
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆350Updated this week
- CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer☆358Updated this week
- Port(ish) of Great Expectations to dbt test macros☆1,083Updated 2 months ago
- Utility functions for dbt projects.☆1,379Updated last week
- Python API for Deequ☆730Updated last month
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,913Updated last week
- dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks☆405Updated last week
- Curated list of resources about Apache Airflow☆3,691Updated 3 months ago
- Making DAG construction easier☆244Updated last week
- Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code☆760Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,552Updated 6 months ago
- PySpark test helper methods with beautiful error messages☆621Updated 3 weeks ago
- An Open Standard for lineage metadata collection☆1,772Updated this week
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆663Updated last month
- pyspark methods to enhance developer productivity 📣 👯 🎉☆643Updated last month
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,824Updated this week
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆465Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,781Updated last week
- Fast iterative local development and testing of Apache Airflow workflows☆193Updated 5 months ago
- Airflow Unit Tests and Integration Tests☆256Updated 2 years ago
- Macros that generate dbt code☆492Updated last month
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆377Updated this week
- List of `pre-commit` hooks to ensure the quality of your `dbt` projects.☆599Updated last week
- A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineer…☆510Updated 3 months ago