awslabs / aws-glue-apache-hudi-operational-data-processing-framework
Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data Platform implementations on the AWS Cloud.
☆21Updated last year
Alternatives and similar repositories for aws-glue-apache-hudi-operational-data-processing-framework:
Users that are interested in aws-glue-apache-hudi-operational-data-processing-framework are comparing it to the libraries listed below
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆22Updated 6 months ago
- ☆31Updated last year
- This Guidance demonstrates how you can extend the data governance capabilities of Amazon DataZone to other Java Database Connectivity (JD…☆13Updated 5 months ago
- CDK Constructs library to aid in building Datalakes on AWS☆21Updated last year
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆25Updated 5 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆67Updated 2 years ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- ☆13Updated 7 months ago
- Using TypeScript and the AWS CDK, you can integrate Knowledge Bases into Amazon Bedrock to provide foundation models with contextual data…☆12Updated 10 months ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 5 months ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆41Updated last month
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- ☆26Updated 7 months ago
- ☆30Updated 11 months ago
- ☆13Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆13Updated 10 months ago
- ☆88Updated last year
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆30Updated last month
- Simplify the process of selecting application sources and preparing data for collaborating in AWS Clean Rooms☆13Updated last year
- ☆17Updated last year
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆28Updated 5 years ago
- Provides real-time data ingestion from OSI PI Data Archive to a modern data architecture on AWS with integrations to OSI PI Asset Framewo…☆9Updated last year
- Replication utility for AWS Glue Data Catalog☆77Updated 7 months ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate☆37Updated last month
- MLOps Pipeline for Amazon Forecast written in AWS CDK☆11Updated last month