aws-samples / streaming-data-lake-flink-cdc-apache-hudi
☆11Updated last year
Alternatives and similar repositories for streaming-data-lake-flink-cdc-apache-hudi:
Users that are interested in streaming-data-lake-flink-cdc-apache-hudi are comparing it to the libraries listed below
- ☆11Updated 7 months ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Serverless Datalake architecture☆12Updated last year
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆21Updated last year
- Kinesis Data Analytics Blueprints are a curated collection of Apache Flink applications. Each blueprint will walk you through how to solv…☆16Updated last year
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 6 months ago
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.☆13Updated 6 months ago
- This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.☆13Updated last month
- ☆21Updated last year
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆31Updated last month
- ☆12Updated 7 months ago
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆12Updated last year
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆31Updated last month
- ☆14Updated 4 years ago
- ☆16Updated 2 years ago
- ☆13Updated this week
- ☆13Updated 5 months ago
- Design best practices for building scalable ETL (Extract-Transform-Load) and ELT (Extract-Load-Transform) data processing pipelines using…☆17Updated 5 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆25Updated 7 months ago
- ☆31Updated last year
- ☆25Updated last year
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆11Updated 6 months ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆19Updated 4 years ago
- ☆30Updated last month
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- ☆30Updated last year
- ☆25Updated last year
- Integrate SageMaker Data Wrangler into your MLOps workflows with Amazon SageMaker Pipelines, AWS Step Functions, and Amazon Managed Workf…☆17Updated 2 years ago