unruly / terraform-aws-airflow
Terraform module for a PostgreSQL-backed Apache Airflow instance
☆24Updated 6 years ago
Alternatives and similar repositories for terraform-aws-airflow:
Users that are interested in terraform-aws-airflow are comparing it to the libraries listed below
- Docker container to make running Luigi tasks real easy.☆11Updated 8 years ago
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 4 months ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 2 years ago
- A Terraform module to create an Amazon Web Services (AWS) Elastic MapReduce (EMR) cluster.☆39Updated 5 years ago
- Terraform Module to create a Apache Spark cluster on AWS☆16Updated 3 years ago
- Provider for AWS Redshift entities, eg Users, Groups, Permissions, Schemas, Databases☆47Updated 2 years ago
- Terraform script for launching multiple EMR clusters for training purposes.☆16Updated last year
- Example Repository for Building Complex Data Pipeline with Luigi +TD☆24Updated 9 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated 2 years ago
- Ansible role to deploy and configure Airflow☆41Updated last month
- Some AWS EMR examples☆16Updated 7 years ago
- A collection of airflow sample workflows for data processing on aws☆12Updated 7 years ago
- ☆54Updated 7 years ago
- ☆11Updated 5 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 4 years ago
- Minimal example of deploying a Docker container to AWS Fargate using Terraform☆46Updated 6 years ago
- Airflow workflow management platform chef cookbook.☆69Updated 5 years ago
- A Helm Chart for Apache Airflow☆14Updated 6 years ago
- Terraform code to create a Kafka message queue in AWS.☆19Updated 6 years ago
- DataHub on AWS demonstration resources☆10Updated last year
- Integrating AWS Lambda with EC2 hosted Relational Databases☆43Updated 8 years ago
- A Pythonic API for Amazon's States Language for defining AWS Step Functions☆8Updated 2 years ago
- An opinionated template for spinning up a dask cluster based on docker.☆14Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 6 years ago
- Python AWS Kinesis Producer with error handling and thread support.☆45Updated 2 years ago