inistar / cicd-cloud-composer
Example script to deploy DAGs to Google Cloud Composer.
☆15Updated 2 years ago
Alternatives and similar repositories for cicd-cloud-composer:
Users that are interested in cicd-cloud-composer are comparing it to the libraries listed below
- Glue VSCode devcontainer setup☆14Updated 2 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 3 months ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- Rules based grant management for Snowflake☆40Updated 6 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago
- ☆34Updated 2 years ago
- AWS Quick Start Team☆18Updated 6 months ago
- An infrastructure as code approach to deploying Snowflake using Terraform☆25Updated last year
- Fully unit tested utility functions for data engineering. Python 3 only.☆16Updated 8 months ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- ☆30Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆35Updated 2 months ago
- event-triggered plugins for airflow☆21Updated 5 years ago
- Big Data Demystified meetup and blog examples☆31Updated 8 months ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- Code to be contributed to the Apache Airflow (incubating) project for ETL workflow management for integrating with the Snowflake Data War…☆25Updated 7 years ago
- Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…☆28Updated 2 years ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- 📆 Run, schedule, and manage your dbt jobs using Kubernetes.☆24Updated 6 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- A _simple_ starter template for Snowflake Cloud Data Platform☆39Updated 3 years ago
- Utility functions for dbt projects running on Spark☆32Updated 2 months ago
- Build DataOps platform with Apache Airflow and dbt on AWS☆55Updated 3 years ago
- ☆21Updated 3 years ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆44Updated 4 months ago
- rb_status_plugin : Data confidence tool for Airflow☆12Updated 2 years ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆115Updated 5 months ago