aws-samples / streaming-data-lake-flink-cdc-apache-hudi
☆11Updated last year
Related projects ⓘ
Alternatives and complementary repositories for streaming-data-lake-flink-cdc-apache-hudi
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆18Updated 2 years ago
- Serverless Datalake architecture☆13Updated last year
- Kinesis Data Analytics Blueprints are a curated collection of Apache Flink applications. Each blueprint will walk you through how to solv…☆16Updated last year
- ☆13Updated 3 months ago
- ☆15Updated last year
- This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.☆11Updated 9 months ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆18Updated 2 months ago
- ☆11Updated 3 weeks ago
- AWS Quick Start Team☆18Updated last month
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆10Updated this week
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆25Updated 2 weeks ago
- This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.☆12Updated 2 months ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆21Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆17Updated 2 months ago
- Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR☆17Updated 3 months ago
- Data Pipeline for CDC data from MySQL DB to Amazon OpenSearch Service through Amazon Kinesis using Amazon Data Migration Service(DMS).☆26Updated 3 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆29Updated 2 months ago
- Demo for GitHub Universe 2022☆12Updated last year
- ☆30Updated 8 months ago
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆28Updated 3 years ago
- ☆25Updated 9 months ago
- Showcases the AsyncIO Functionality within Apache Flink for Kinesis Data Analytics☆10Updated last year
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆11Updated last year
- ☆14Updated 3 years ago
- A project template for developing BYOD docker images for use in Amazon SageMaker.☆19Updated 4 years ago
- A tool to automate analytic platform evaluations. Barometer helps customers to get data points needed for service selection/service confi…☆18Updated 5 months ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Updated 5 years ago
- In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (…☆12Updated 3 months ago