aws-samples / aws-glue-streaming-ingestion-from-kafka-to-apache-icebergLinks
This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
☆13Updated 9 months ago
Alternatives and similar repositories for aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg
Users that are interested in aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg are comparing it to the libraries listed below
Sorting:
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 9 months ago
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆13Updated last year
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆32Updated 4 months ago
- ☆73Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- ☆14Updated 2 years ago
- ☆26Updated 10 months ago
- ☆31Updated last year
- ☆32Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 10 months ago
- Samples to help you get started with the Amazon Redshift Data API☆73Updated last year
- ☆12Updated last year
- ☆12Updated 10 months ago
- ☆12Updated 2 years ago
- ☆15Updated 2 years ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆42Updated this week
- ☆11Updated 10 months ago
- ☆27Updated last year
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆43Updated last year
- ☆22Updated 9 months ago
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆13Updated last year
- ☆34Updated 2 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 2 years ago
- ☆54Updated last year
- ☆25Updated last year
- ☆22Updated 4 months ago
- Replication utility for AWS Glue Data Catalog☆79Updated 10 months ago
- ☆88Updated last year