unruly / terraform-aws-airflow
Terraform module for a PostgreSQL-backed Apache Airflow instance
☆24Updated 6 years ago
Related projects: ⓘ
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 2 weeks ago
- A collection of airflow sample workflows for data processing on aws☆12Updated 6 years ago
- Terraform script for launching multiple EMR clusters for training purposes.☆16Updated 10 months ago
- Docker container to make running Luigi tasks real easy.☆11Updated 8 years ago
- ☆41Updated this week
- Minimal example of deploying a Docker container to AWS Fargate using Terraform☆47Updated 5 years ago
- ☆54Updated 7 years ago
- Cloudformation and SQL scripts used to replicate a POC environment from the "Data Lake to Data Warehouse: Enhancing Customer 360 with Ama…☆30Updated 4 years ago
- ☆20Updated this week
- PREVIEW - Run Bonobo data processing graphs in docker containers.☆13Updated last year
- Provider for AWS Redshift entities, eg Users, Groups, Permissions, Schemas, Databases☆47Updated 2 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 5 years ago
- A Terraform module to create an Amazon Web Services (AWS) Elastic MapReduce (EMR) cluster.☆39Updated 4 years ago
- Example Repository for Building Complex Data Pipeline with Luigi +TD☆24Updated 9 years ago
- ☆45Updated 6 years ago
- Code to be contributed to the Apache Airflow (incubating) project for ETL workflow management for integrating with the Snowflake Data War…☆25Updated 7 years ago
- Integrating AWS Lambda with EC2 hosted Relational Databases☆43Updated 8 years ago
- A Pythonic API for Amazon's States Language for defining AWS Step Functions☆8Updated last year
- ☆10Updated this week
- Airflow workflow management platform chef cookbook.☆67Updated 5 years ago
- Ansible role to deploy and configure Airflow☆41Updated this week
- CLI tool to launch Spark jobs on AWS EMR☆67Updated 11 months ago
- pg2kinesis uses logical decoding in Postgres 9.4 or later to capture a consistent, continuous stream of events from the database and publ…☆59Updated last year
- Utility to monitor AWS Redshift Performance☆12Updated 8 years ago
- run SQL queries on AWS Athena from jupyter notebooks☆19Updated 5 years ago
- Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow☆29Updated 7 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Updated 9 months ago
- ☆11Updated 4 years ago
- ☆10Updated this week
- Example for an airflow plugin☆49Updated 8 years ago