talperetz / scalable-airflow-template
fast and scalable Airflow on Kubernetes Setup.
☆28Updated last year
Related projects ⓘ
Alternatives and complementary repositories for scalable-airflow-template
- scaffold of Apache Airflow executing Docker containers☆85Updated last year
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated last year
- Airflow Unit Tests and Integration Tests☆256Updated last year
- A guide to running Airflow on Kubernetes☆171Updated 5 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- pytest plugin to run the tests with support of pyspark☆85Updated 8 months ago
- ☆43Updated 2 years ago
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Updated 2 weeks ago
- Pylint plugin for static code analysis on Airflow code☆90Updated 4 years ago
- ☆196Updated last year
- Astronomer Core Docker Images☆106Updated 5 months ago
- Airflow helm chart for AWS EKS☆18Updated 3 years ago
- ☆12Updated 4 years ago
- ☆127Updated 4 years ago
- REST-like API exposing Airflow data and operations☆61Updated 5 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆193Updated 4 months ago
- rb_status_plugin : Data confidence tool for Airflow☆12Updated last year
- Great Expectations Airflow operator☆159Updated last week
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 6 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆110Updated last year
- A complete development environment setup for working with Airflow☆126Updated last year
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆137Updated this week
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Collection of transforms for the Apache beam python SDK.☆87Updated 11 months ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 3 years ago
- Airflow Backfill UI based plugin for existing / new Airflow environment☆66Updated 3 years ago
- triggering a DAG run multiple times☆85Updated 8 months ago
- 🐋 Docker image for AWS Glue Spark/Python☆22Updated last year