inistar / cicd-cloud-composerLinks
Example script to deploy DAGs to Google Cloud Composer.
☆15Updated 2 years ago
Alternatives and similar repositories for cicd-cloud-composer
Users that are interested in cicd-cloud-composer are comparing it to the libraries listed below
Sorting:
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- event-triggered plugins for airflow☆21Updated 5 years ago
- Demo for GitHub Universe 2022☆12Updated 2 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆37Updated 5 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 2 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago
- Glue VSCode devcontainer setup☆14Updated 2 years ago
- a pytest plugin for dbt adapter test suites☆19Updated last year
- Spark app to merge different schemas☆23Updated 4 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Utility functions for dbt projects running on Spark☆34Updated 4 months ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 5 months ago
- Rules based grant management for Snowflake☆40Updated 6 years ago
- Examples for High Performance Spark☆16Updated 7 months ago
- Streaming demo dbt☆17Updated 9 months ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆17Updated 10 months ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- ☆34Updated 2 years ago
- Collection of utility scripts to extract code so it can be upgraded to SnowFlake using the SnowConvert tool.☆16Updated this week
- An infrastructure as code approach to deploying Snowflake using Terraform☆25Updated 2 years ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 5 years ago
- Code to be contributed to the Apache Airflow (incubating) project for ETL workflow management for integrating with the Snowflake Data War…☆25Updated 7 years ago
- DBT Cloud Plugin for Airflow☆38Updated last year
- Materials of the Official Helm Chart Webinar☆27Updated 4 years ago
- ☆31Updated last year
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Repo with scripts and automation to help ensure best practices in Google Data Catalog☆13Updated 3 years ago