infinitelambda / apache_airflow_on_eks
☆28Updated last year
Related projects ⓘ
Alternatives and complementary repositories for apache_airflow_on_eks
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Updated 3 weeks ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- ☆60Updated 2 years ago
- The athena adapter plugin for dbt (https://getdbt.com)☆141Updated last year
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆153Updated this week
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆25Updated last year
- Cloudformation templates for deploying Airflow in ECS☆40Updated 5 years ago
- Materials for the next course☆22Updated last year
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated last year
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Turbine: the bare metals that gets you Airflow☆377Updated 3 years ago
- Great Expectations Airflow operator☆159Updated 3 weeks ago
- Build DataOps platform with Apache Airflow and dbt on AWS☆51Updated 3 years ago
- A terraform module that creates an airflow instance in AWS ECS.☆59Updated last year
- ☆127Updated 4 years ago
- Spark runtime on AWS Lambda☆94Updated 2 months ago
- Redshift package for dbt (getdbt.com)☆99Updated last year
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆106Updated last week
- Performant Redshift data source for Apache Spark☆136Updated 3 months ago
- A guide to running Airflow on Kubernetes☆172Updated 5 years ago
- Airflow Executor for both AWS ECS & AWS Fargate☆52Updated last year
- A compact framework for automating a Snowflake analytics pipeline on Amazon ECS.☆18Updated last year
- This repository shows a sample example to build, manage and orchestrate Machine Learning workflows using Amazon Sagemaker and Apache Airf…☆137Updated 3 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆111Updated last year
- Docker image for running Spark 3 on Kubernetes on AWS☆27Updated 3 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆167Updated last year
- The athena adapter plugin for dbt (https://getdbt.com)☆227Updated this week
- Resources for video demonstrations and blog posts related to DataOps on AWS☆170Updated 2 years ago