aws-samples / aws-glue-streaming-ingestion-from-kafka-to-apache-icebergLinks
This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
☆13Updated 10 months ago
Alternatives and similar repositories for aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg
Users that are interested in aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg are comparing it to the libraries listed below
Sorting:
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 10 months ago
- ☆15Updated 2 years ago
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆13Updated 2 years ago
- ☆73Updated last year
- ☆15Updated 2 years ago
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆13Updated last year
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆32Updated 4 months ago
- ☆31Updated last year
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆30Updated 3 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- ☆32Updated last year
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆93Updated 2 years ago
- ☆18Updated last year
- An open-source framework that simplifies implementation of data solutions.☆139Updated this week
- ☆22Updated 10 months ago
- Spark runtime on AWS Lambda☆108Updated 9 months ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 2 years ago
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆93Updated 5 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 10 months ago
- CDK Snippets from example projects☆16Updated 2 years ago
- ☆34Updated 2 years ago
- ☆15Updated 8 months ago
- aws-samples / automating-pii-data-detection-and-data-masking-tasks-with-aws-glue-databrew-and-aws-step-functions☆23Updated 3 years ago
- This solution provides the AWS CDK and AWS CloudFormation infrastructure to build an enterprise data mesh with Amazon DataZone.☆9Updated 2 months ago
- ☆12Updated 11 months ago
- Samples to help you get started with the Amazon Redshift Data API☆73Updated last year
- Demo for GitHub Universe 2022☆12Updated 2 years ago
- ☆16Updated 2 years ago
- This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.☆13Updated 10 months ago