awslabs / aws-glue-apache-hudi-operational-data-processing-framework
Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data Platform implementations on the AWS Cloud.
☆21Updated last year
Alternatives and similar repositories for aws-glue-apache-hudi-operational-data-processing-framework:
Users that are interested in aws-glue-apache-hudi-operational-data-processing-framework are comparing it to the libraries listed below
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆22Updated 6 months ago
- ☆31Updated last year
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆67Updated 2 years ago
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆13Updated 10 months ago
- Examples for consuming Private API Gateway across AWS Accounts☆19Updated 3 months ago
- ☆30Updated 11 months ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- ☆26Updated 7 months ago
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- ☆13Updated last year
- A collection of examples built with AWS DataOps Development Kit (DDK)☆41Updated last month
- Easily upload first-party signals into Amazon Marketing Cloud (AMC) for evaluating and planning advertising campaigns☆20Updated last week
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆30Updated last month
- Using TypeScript and the AWS CDK, you can integrate Knowledge Bases into Amazon Bedrock to provide foundation models with contextual data…☆12Updated 10 months ago
- CDK Constructs library to aid in building Datalakes on AWS☆21Updated last year
- ☆13Updated 7 months ago
- This github repo contains Aurora MySQL and PostgreSQL Labs, Aurora Serverless Lab and Heterogeneous database migration with DMS Labs.☆30Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- This Guidance demonstrates how you can extend the data governance capabilities of Amazon DataZone to other Java Database Connectivity (JD…☆13Updated 4 months ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 5 months ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆25Updated 5 years ago
- ☆17Updated last year
- ☆14Updated last year
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆12Updated last year
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆28Updated 5 years ago
- ☆25Updated last year
- This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.☆13Updated last month
- Serverless Datalake architecture☆12Updated last year
- The Generative AI Atlas is an organized repository designed for individuals seeking to explore the newest content released by AWS on Gene…☆16Updated 2 months ago