skhatri / airflow-by-exampleLinks
Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes master. Secure it with keycloak
☆23Updated 3 years ago
Alternatives and similar repositories for airflow-by-example
Users that are interested in airflow-by-example are comparing it to the libraries listed below
Sorting:
- (project & tutorial) dag pipeline tests + ci/cd setup☆90Updated 4 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Great Expectations Airflow operator☆169Updated this week
- Astronomer Core Docker Images☆105Updated last year
- Fast iterative local development and testing of Apache Airflow workflows☆203Updated last month
- Enforce Best Practices for all your Airflow DAGs. ⭐☆108Updated this week
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated last week
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆225Updated 9 months ago
- Airflow Unit Tests and Integration Tests☆261Updated 3 years ago
- ☆23Updated 4 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆51Updated last month
- ☆201Updated 2 years ago
- Pylint plugin for static code analysis on Airflow code☆97Updated 5 years ago
- rb_status_plugin : Data confidence tool for Airflow☆12Updated 3 years ago
- Making DAG construction easier☆283Updated last month
- A Helm chart to install Apache Airflow on Kubernetes☆291Updated this week
- Code examples showing flow deployment to various types of infrastructure☆110Updated 3 years ago
- Delta Lake helper methods. No Spark dependency.☆22Updated last week
- Airflow training for the crunch conf☆105Updated 7 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆348Updated 7 years ago
- ☆52Updated 5 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆166Updated 4 years ago
- ☆49Updated 4 years ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆377Updated 8 months ago
- Parse dbt artifacts and search dbt models with Algolia☆52Updated 4 years ago
- triggering a DAG run multiple times☆88Updated last year
- A complete development environment setup for working with Airflow☆129Updated 2 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Updated 2 years ago