Turbine: the bare metals that gets you Airflow
☆377Oct 10, 2021Updated 5 years ago
Alternatives and similar repositories for aws-airflow-stack
Users that are interested in aws-airflow-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cloudformation templates for deploying Airflow in ECS☆39Nov 27, 2018Updated 7 years ago
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Oct 24, 2024Updated 2 years ago
- ☆21Dec 8, 2022Updated 3 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆83Jan 13, 2023Updated 3 years ago
- Docker Apache Airflow☆3,811Mar 1, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Curated list of resources about Apache Airflow☆3,939Oct 5, 2026Updated 3 weeks ago
- Fast iterative local development and testing of Apache Airflow workflows☆205Oct 26, 2026Updated last week
- Demo deployment of Apache Airflow on EC2/Ubuntu with Docker-compose, Terraform, and Ansible☆11Dec 1, 2017Updated 8 years ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,774Jun 18, 2024Updated 2 years ago
- Functional Airflow DAG definitions.☆38Jul 4, 2017Updated 9 years ago
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆490Updated this week
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆77Oct 30, 2018Updated 8 years ago
- Airflow plugin to transfer arbitrary files between operators☆79Oct 19, 2018Updated 8 years ago
- Airflow Deployment on AWS ECS Fargate Using Cloudformation☆206Jun 22, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆12Sep 2, 2021Updated 5 years ago
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆234Aug 24, 2022Updated 4 years ago
- A guide to running Airflow on Kubernetes☆172Jul 3, 2019Updated 7 years ago
- Construct Apache Airflow DAGs Declaratively via YAML configuration files☆1,465Updated this week
- A docker image and kubernetes config files to run Airflow on Kubernetes☆653Jul 19, 2019Updated 7 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆349Jul 24, 2018Updated 8 years ago
- A Terraform template for provisioning Apache Airflow workflows on AWS ECS Fargate☆14May 28, 2020Updated 6 years ago
- Airflow Unit Tests and Integration Tests☆263Nov 16, 2022Updated 3 years ago
- ETL best practices with airflow, with examples☆1,360Sep 25, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,122Updated this week
- A plugin to Apache Airflow to allow you to run Zip and UnZip commands as an Operator☆12Jul 26, 2023Updated 3 years ago
- A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces☆326Dec 16, 2020Updated 5 years ago
- Airflow plugin to export dag and task based metrics to Prometheus.☆281Updated this week
- ☆13Jun 30, 2025Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆177Apr 13, 2026Updated 6 months ago
- Visualize dependencies between Airflow DAGs☆49May 7, 2021Updated 5 years ago
- Constructs to deploy airflow via the aws cdk☆28Sep 21, 2020Updated 6 years ago
- Copy Pandas DataFrames and HDF5 files to PostgreSQL database☆57Jun 5, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Jul 19, 2023Updated 3 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆298Updated this week
- Utilities for writing tests that use Apache Spark.☆24Dec 29, 2018Updated 7 years ago
- A collection of airflow sample workflows for data processing on aws☆12Dec 1, 2017Updated 8 years ago
- Airflow Executor for both AWS ECS & AWS Fargate☆52May 18, 2023Updated 3 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Sep 20, 2019Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Nov 6, 2018Updated 7 years ago