aws-solutions-library-samples / aws-insurancelake-etl
This solution helps you deploy ETL processes and data storage resources to create an Insurance Lake using Amazon S3 buckets for storage, AWS Glue for data transformation, and AWS CDK Pipelines. It is originally based on the AWS blog Deploy data lake ETL jobs using CDK Pipelines, and complements the InsuranceLake Infrastructure project
☆23Updated 2 months ago
Alternatives and similar repositories for aws-insurancelake-etl:
Users that are interested in aws-insurancelake-etl are comparing it to the libraries listed below
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆21Updated last year
- ☆31Updated 11 months ago
- dbt / Amazon Redshift Demonstration Project☆33Updated 2 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆67Updated 2 years ago
- ☆12Updated last year
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆26Updated this week
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆26Updated 3 months ago
- ☆16Updated 9 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆23Updated 5 months ago
- ☆12Updated last month
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆17Updated 3 years ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Updated 5 years ago
- ☆67Updated 7 months ago
- ☆32Updated 10 months ago
- Starter project to create a dashboard to interact with Amazon Connect Global Resiliency APIs☆12Updated 11 months ago
- ☆26Updated 5 months ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆12Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆40Updated 2 years ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆40Updated this week
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆42Updated last month
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆20Updated 4 months ago
- ☆10Updated last week
- ☆34Updated 2 years ago
- Serverless Datalake architecture☆12Updated last year
- ☆29Updated 10 months ago
- ☆51Updated 9 months ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆49Updated last year
- ☆16Updated 7 months ago