aws-samples / aws-glue-streaming-ingestion-from-kafka-to-apache-icebergLinks
This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
☆14Updated last year
Alternatives and similar repositories for aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg
Users that are interested in aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg are comparing it to the libraries listed below
Sorting:
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆25Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆44Updated 3 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated 2 years ago
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆30Updated 4 years ago
- An open-source framework that simplifies implementation of data solutions.☆146Updated last month
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆99Updated 3 years ago
- Samples to help you get started with the Amazon Redshift Data API☆71Updated 2 years ago
- ☆72Updated last year
- ☆32Updated last year
- ☆15Updated last week
- ☆23Updated 10 months ago
- ☆32Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆31Updated 2 years ago
- ☆12Updated last year
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆119Updated last month
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆34Updated 10 months ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 3 years ago
- ☆14Updated 2 years ago
- Spark runtime on AWS Lambda☆113Updated 4 months ago
- Replication utility for AWS Glue Data Catalog☆79Updated last year
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆94Updated 11 months ago
- ☆159Updated last year
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆13Updated 2 years ago
- ☆11Updated 3 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆168Updated last year
- ☆54Updated 5 months ago
- Examples to get you started with Amazon Redshift ML☆19Updated 2 years ago
- ☆19Updated last year
- ☆89Updated 2 years ago
- ☆34Updated 3 years ago