inistar / cicd-cloud-composer
Example script to deploy DAGs to Google Cloud Composer.
☆15Updated 2 years ago
Alternatives and similar repositories for cicd-cloud-composer:
Users that are interested in cicd-cloud-composer are comparing it to the libraries listed below
- Rules based grant management for Snowflake☆40Updated 5 years ago
- AWS Quick Start Team☆18Updated 3 months ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆42Updated last month
- Spark app to merge different schemas☆23Updated 4 years ago
- Terraform module for deploying the Prefect Agent on AWS EC2☆13Updated 2 years ago
- Git repo to accompany the AWS DevOps Blog: Using AWS DevOps Tools to model and provision AWS Glue workflows☆19Updated 3 years ago
- Repo with scripts and automation to help ensure best practices in Google Data Catalog☆13Updated 2 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆111Updated last year
- Glue VSCode devcontainer setup☆14Updated 2 years ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆15Updated 5 months ago
- ☆34Updated 2 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 3 weeks ago
- Glue Python Shell Job that adds AWS Organizations account tags to Cost and Usage Reports. You can submit feedback & requests for changes…☆16Updated 3 years ago
- ☆12Updated 3 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 4 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- ☆29Updated 10 months ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- Yet Another (Spark) ETL Framework☆18Updated last year
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆49Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated last year
- A bunch of hacks developed around dbt☆48Updated 5 years ago
- Run dbt serverless in the Cloud (AWS)☆41Updated 5 years ago
- ☆14Updated 5 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- Useful scripts, utilities, and tools for Snowflake☆13Updated 4 years ago