talperetz / scalable-airflow-template
fast and scalable Airflow on Kubernetes Setup.
☆28Updated last year
Related projects ⓘ
Alternatives and complementary repositories for scalable-airflow-template
- scaffold of Apache Airflow executing Docker containers☆85Updated last year
- Fast iterative local development and testing of Apache Airflow workflows☆193Updated 5 months ago
- Pylint plugin for static code analysis on Airflow code☆90Updated 4 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆22Updated last year
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated last year
- ☆12Updated 4 years ago
- ☆43Updated 2 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- Airflow Unit Tests and Integration Tests☆256Updated 2 years ago
- REST-like API exposing Airflow data and operations☆61Updated 5 years ago
- A guide to running Airflow on Kubernetes☆172Updated 5 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 4 years ago
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Updated 3 weeks ago
- Great Expectations Airflow operator☆159Updated 3 weeks ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆110Updated last year
- Astronomer Core Docker Images☆106Updated 6 months ago
- ☆60Updated 2 years ago
- The athena adapter plugin for dbt (https://getdbt.com)☆141Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 6 years ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆137Updated this week
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆80Updated 6 months ago
- A Helm chart to install Apache Airflow on Kubernetes☆276Updated this week
- dbt adapter for Athena☆39Updated 5 months ago
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆40Updated last week