aws-samples / aws-glue-streaming-ingestion-from-kafka-to-apache-icebergLinks
This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
☆14Updated last year
Alternatives and similar repositories for aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg
Users that are interested in aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg are comparing it to the libraries listed below
Sorting:
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆24Updated last year
- ☆32Updated last year
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆33Updated 6 months ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated last year
- ☆73Updated last year
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆12Updated last year
- Spark runtime on AWS Lambda☆109Updated 2 weeks ago
- An open-source framework that simplifies implementation of data solutions.☆143Updated this week
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆98Updated 3 years ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆115Updated 2 months ago
- ☆12Updated last year
- ☆14Updated 2 years ago
- ☆88Updated last year
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 3 years ago
- ☆15Updated last month
- Examples to get you started with Amazon Redshift ML☆19Updated last year
- ☆158Updated last year
- ☆32Updated last year
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 11 months ago
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆30Updated 4 years ago
- Collection of code examples for Amazon Managed Service for Apache Flink☆67Updated 2 weeks ago
- Samples to help you get started with the Amazon Redshift Data API☆71Updated 2 years ago
- ☆55Updated last month
- Example code for running Spark and Hive jobs on EMR Serverless.☆167Updated 8 months ago
- ☆22Updated 6 months ago
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆93Updated 7 months ago
- Demo for GitHub Universe 2022☆13Updated 2 years ago
- In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (…☆13Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated last year