talperetz / scalable-airflow-templateLinks
fast and scalable Airflow on Kubernetes Setup.
☆28Updated 2 years ago
Alternatives and similar repositories for scalable-airflow-template
Users that are interested in scalable-airflow-template are comparing it to the libraries listed below
Sorting:
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated 2 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆201Updated last month
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- A guide to running Airflow on Kubernetes☆173Updated 5 years ago
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Updated 7 months ago
- ☆199Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated last year
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Airflow Unit Tests and Integration Tests☆259Updated 2 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆341Updated 6 years ago
- Amazon Redshift SQLAlchemy Dialect☆223Updated 11 months ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- ☆12Updated 4 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Great Expectations Airflow operator☆165Updated this week
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Astronomer Core Docker Images☆107Updated last year
- Collection of transforms for the Apache beam python SDK.☆89Updated last year
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆148Updated this week
- rb_status_plugin : Data confidence tool for Airflow☆12Updated 2 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- ☆61Updated 3 years ago
- ☆127Updated 4 years ago
- Singer.io Target for Snowflake - PipelineWise compatible☆51Updated 8 months ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- ☆47Updated 3 years ago
- Creates a Simulation of Fake Web Events☆84Updated 3 years ago