aws-solutions-library-samples / aws-insurancelake-etlLinks
This solution helps you deploy ETL processes and data storage resources to create an Insurance Lake using Amazon S3 buckets for storage, AWS Glue for data transformation, and AWS CDK Pipelines. It is originally based on the AWS blog Deploy data lake ETL jobs using CDK Pipelines, and complements the InsuranceLake Infrastructure project
☆26Updated last month
Alternatives and similar repositories for aws-insurancelake-etl
Users that are interested in aws-insurancelake-etl are comparing it to the libraries listed below
Sorting:
- ☆54Updated last year
- ☆13Updated last year
- ☆32Updated last year
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 2 years ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆46Updated 6 months ago
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆41Updated 2 years ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆25Updated 6 years ago
- ☆26Updated 9 months ago
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆12Updated 8 months ago
- aws-solutions-library-samples / guidance-for-preparing-and-validating-records-for-entity-resolution-on-awsThis Guidance demonstrates how to prepare and validate Personally Identifiable Information (PII) data, including physical address, phone,…☆9Updated 7 months ago
- Serverless ETL and Analytics with AWS Glue, published by Packt☆48Updated last year
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 8 months ago
- This Guidance demonstrates how you can extend the data governance capabilities of Amazon DataZone to other Java Database Connectivity (JD…☆13Updated 7 months ago
- This solution provides the AWS CDK and AWS CloudFormation infrastructure to build an enterprise data mesh with Amazon DataZone.☆9Updated 3 weeks ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆27Updated 9 months ago
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆13Updated last year
- ☆34Updated 2 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆22Updated last year
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆27Updated 2 months ago
- This reference architecture demonstrates the use of AWS Step Functions to orchestrate an Extract Transfer Load (ETL) workflow with AWS La…☆24Updated 4 years ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 8 months ago
- Integrate SageMaker Data Wrangler into your MLOps workflows with Amazon SageMaker Pipelines, AWS Step Functions, and Amazon Managed Workf…☆18Updated 2 years ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆29Updated last year
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- ☆13Updated this week
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆32Updated 3 months ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- Question Answering application with Large Language Models (LLMs) and Amazon Postgresql using pgvector☆16Updated 6 months ago