aws-solutions-library-samples / guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks
A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such as analysts and data scientists) access their data and create meaningful insights without the need for manual IT processes.
☆29Updated 11 months ago
Alternatives and similar repositories for guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks:
Users that are interested in guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks are comparing it to the libraries listed below
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆67Updated 2 years ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆30Updated last month
- ☆88Updated last year
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆17Updated 3 years ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆98Updated 4 years ago
- ☆16Updated 11 months ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 5 months ago
- ☆27Updated 4 years ago
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆26Updated last month
- ☆69Updated 9 months ago
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- ☆88Updated 2 years ago
- AWS Quick Start Team☆18Updated 5 months ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆22Updated 6 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- An open-source framework that simplifies implementation of data solutions.☆128Updated this week
- ☆26Updated 7 months ago
- ☆31Updated last year
- ☆47Updated last year
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- ☆16Updated 8 months ago
- ☆73Updated last year
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆63Updated 3 weeks ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆41Updated last month
- ☆33Updated last year
- Build DataOps platform with Apache Airflow and dbt on AWS☆55Updated 3 years ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- ☆26Updated last year