moj-analytical-services / dataengineeringutils3Links
Fully unit tested utility functions for data engineering. Python 3 only.
☆17Updated 10 months ago
Alternatives and similar repositories for dataengineeringutils3
Users that are interested in dataengineeringutils3 are comparing it to the libraries listed below
Sorting:
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- Collection of utility scripts to extract code so it can be upgraded to SnowFlake using the SnowConvert tool.☆20Updated this week
- An infrastructure as code approach to deploying Snowflake using Terraform☆25Updated 2 years ago
- Glue VSCode devcontainer setup☆14Updated 2 years ago
- Activity Schema dbt package☆15Updated last year
- Example script to deploy DAGs to Google Cloud Composer.☆15Updated 3 years ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- Rules based grant management for Snowflake☆40Updated 6 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- DataHub on AWS demonstration resources☆10Updated 2 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆37Updated 5 years ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- A bunch of hacks developed around dbt☆48Updated 5 years ago
- Spark app to merge different schemas☆22Updated 4 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 10 months ago
- Orchestrating ELT using the modern data stack☆10Updated 3 years ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆47Updated 7 months ago
- Dask integration for Snowflake☆30Updated 8 months ago
- Useful scripts, utilities, and tools for Snowflake☆13Updated 5 years ago
- Creates simple data models on Snowflake to report dbt source freshness and tests☆26Updated 2 years ago
- Palm CLI - the tool-belt for data teams☆47Updated last year
- A _simple_ starter template for Snowflake Cloud Data Platform☆39Updated 3 years ago
- ☆1Updated 10 months ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 5 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 10 months ago
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 4 years ago
- ☆11Updated 5 years ago
- Content for a talk on "The wonderful world of data quality tools in Python"☆18Updated 4 years ago
- Run dbt serverless in the Cloud (AWS)☆43Updated 5 years ago
- dbt package for monitoring airflow DAGs and tasks☆29Updated 5 months ago