aws-solutions-library-samples / guidance-for-sql-based-etl-with-apache-spark-on-amazon-eksLinks
A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such as analysts and data scientists) access their data and create meaningful insights without the need for manual IT processes.
☆29Updated last year
Alternatives and similar repositories for guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks
Users that are interested in guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks are comparing it to the libraries listed below
Sorting:
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆32Updated 4 months ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆93Updated 2 years ago
- ☆88Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆28Updated 4 years ago
- In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (…☆13Updated 11 months ago
- ☆27Updated 4 years ago
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆64Updated last week
- ☆54Updated last year
- Replication utility for AWS Glue Data Catalog☆79Updated 10 months ago
- ☆73Updated last year
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 9 months ago
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆30Updated 3 years ago
- ☆48Updated last year
- ☆18Updated 11 months ago
- Build DataOps platform with Apache Airflow and dbt on AWS☆55Updated 4 years ago
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆27Updated 2 months ago
- An open-source framework that simplifies implementation of data solutions.☆138Updated this week
- Spark ETL example processing New York taxi rides public dataset on EKS☆45Updated 2 years ago
- ☆74Updated last year
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 9 months ago
- Design best practices for building scalable ETL (Extract-Transform-Load) and ELT (Extract-Load-Transform) data processing pipelines using…☆17Updated 5 years ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Updated 6 years ago
- ☆32Updated last year
- ☆12Updated 10 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- A Data Platform built for AWS, powered by Kubernetes.☆148Updated last year
- A collection of examples built with AWS DataOps Development Kit (DDK)☆42Updated last week