infinitelambda / apache_airflow_on_eks
☆28Updated last year
Related projects ⓘ
Alternatives and complementary repositories for apache_airflow_on_eks
- Materials for the next course☆22Updated last year
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆25Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- A terraform module that creates an airflow instance in AWS ECS.☆59Updated last year
- Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks☆159Updated 2 weeks ago
- The athena adapter plugin for dbt (https://getdbt.com)☆141Updated last year
- Great Expectations Airflow operator☆159Updated last week
- Redshift package for dbt (getdbt.com)☆99Updated last year
- Sample Airflow DAGs☆61Updated last year
- A Terraform template for provisioning Apache Airflow workflows on AWS ECS Fargate☆14Updated 4 years ago
- ☆60Updated 2 years ago
- Build DataOps platform with Apache Airflow and dbt on AWS☆51Updated 3 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 5 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆110Updated last year
- Example code for running Spark and Hive jobs on EMR Serverless.☆151Updated 2 weeks ago
- Cloud Build for Deploying Datapipelines with Composer, Dataflow and BigQuery☆64Updated 4 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Airflow support for Marquez☆32Updated 3 years ago
- Airflow helm chart for AWS EKS☆18Updated 3 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆166Updated last year
- Performant Redshift data source for Apache Spark☆136Updated 3 months ago
- Data pipeline with dbt, Airflow, Great Expectations☆158Updated 3 years ago
- ☆196Updated last year
- A guide to running Airflow on Kubernetes☆171Updated 5 years ago
- Rules based grant management for Snowflake☆40Updated 5 years ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated last year
- Docker image for running Spark 3 on Kubernetes on AWS☆27Updated 3 years ago