skhatri / airflow-by-exampleLinks
Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes master. Secure it with keycloak
☆23Updated 3 years ago
Alternatives and similar repositories for airflow-by-example
Users that are interested in airflow-by-example are comparing it to the libraries listed below
Sorting:
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Great Expectations Airflow operator☆170Updated last week
- triggering a DAG run multiple times☆88Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆90Updated 4 years ago
- Astronomer Core Docker Images☆105Updated last year
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆225Updated 9 months ago
- Making DAG construction easier☆283Updated last month
- Enforce Best Practices for all your Airflow DAGs. ⭐☆108Updated 2 weeks ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated 2 weeks ago
- ☆23Updated 4 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆204Updated last month
- Data pipeline with dbt, Airflow, Great Expectations☆166Updated 4 years ago
- Airflow Unit Tests and Integration Tests☆261Updated 3 years ago
- A complete development environment setup for working with Airflow☆129Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆110Updated 3 years ago
- Snowflake SQLAlchemy☆261Updated this week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- New generation opensource data stack☆76Updated 3 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆52Updated last month
- Airflow training for the crunch conf☆105Updated 7 years ago
- Pylint plugin for static code analysis on Airflow code☆97Updated 5 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆126Updated 3 years ago
- ☆201Updated 2 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆183Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- ☆49Updated 4 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆294Updated last week
- Example DAGs using hooks and operators from Airflow Plugins☆348Updated 7 years ago