astronomer / dag-factory
Dynamically generate Apache Airflow DAGs from YAML configuration files
☆1,231Updated this week
Alternatives and similar repositories for dag-factory:
Users that are interested in dag-factory are comparing it to the libraries listed below
- Guides and docs to help you get up and running with Apache Airflow.☆804Updated 2 years ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,697Updated 7 months ago
- ETL best practices with airflow, with examples☆1,313Updated 3 months ago
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆413Updated this week
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆360Updated this week
- Apache Airflow integration for dbt☆400Updated 8 months ago
- Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code☆818Updated this week
- CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer☆370Updated this week
- Python API for Deequ☆738Updated 3 months ago
- Curated list of resources about Apache Airflow☆3,722Updated 4 months ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,973Updated this week
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆467Updated this week
- A Helm chart to install Apache Airflow on Kubernetes☆281Updated this week
- Utility functions for dbt projects.☆1,426Updated last month
- re_data - fix data issues before your users & CEO would discover them 😊☆1,563Updated 8 months ago
- Making DAG construction easier☆248Updated this week
- Example DAGs using hooks and operators from Airflow Plugins☆334Updated 6 years ago
- An Open Standard for lineage metadata collection☆1,818Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,819Updated this week
- A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces☆325Updated 4 years ago
- PySpark test helper methods with beautiful error messages☆648Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,961Updated this week
- 📙 Awesome Data Catalogs and Observability Platforms.☆762Updated 5 months ago
- Port(ish) of Great Expectations to dbt test macros☆1,127Updated last month
- Airflow Unit Tests and Integration Tests☆256Updated 2 years ago
- dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks☆413Updated this week
- A curated list of data engineering tools for software developers☆465Updated 7 years ago
- Generate and Visualize Data Lineage from query history☆315Updated last year
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆671Updated 3 months ago
- A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineer…☆522Updated 4 months ago