talperetz / scalable-airflow-templateLinks
fast and scalable Airflow on Kubernetes Setup.
☆28Updated 2 years ago
Alternatives and similar repositories for scalable-airflow-template
Users that are interested in scalable-airflow-template are comparing it to the libraries listed below
Sorting:
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆201Updated 2 months ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated 2 years ago
- A guide to running Airflow on Kubernetes☆173Updated 5 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Updated 8 months ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- ☆199Updated last year
- Example DAGs using hooks and operators from Airflow Plugins☆341Updated 6 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- Great Expectations Airflow operator☆166Updated last week
- Airflow Unit Tests and Integration Tests☆259Updated 2 years ago
- ☆127Updated 5 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- Airflow training for the crunch conf☆105Updated 6 years ago
- Astronomer Core Docker Images☆107Updated last year
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Apache Avro <-> pandas DataFrame☆137Updated 11 months ago
- A Helm chart to install Apache Airflow on Kubernetes☆284Updated this week
- ☆61Updated 3 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆80Updated last year
- Collection of transforms for the Apache beam python SDK.☆89Updated last year
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆148Updated 8 years ago
- Singer.io Target for Snowflake - PipelineWise compatible☆51Updated 9 months ago
- Airflow Backfill UI based plugin for existing / new Airflow environment☆65Updated 4 years ago