aws-solutions-library-samples / guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks
A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such as analysts and data scientists) access their data and create meaningful insights without the need for manual IT processes.
☆29Updated 11 months ago
Alternatives and similar repositories for guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks:
Users that are interested in guidance-for-sql-based-etl-with-apache-spark-on-amazon-eks are comparing it to the libraries listed below
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆67Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- ☆88Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆41Updated 2 years ago
- ☆72Updated 10 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆63Updated last week
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆31Updated last month
- ☆73Updated last year
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 6 months ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆98Updated 4 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 7 months ago
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆13Updated 11 months ago
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆17Updated 3 years ago
- ☆31Updated last year
- ☆16Updated last year
- ☆14Updated 2 years ago
- ☆27Updated 4 years ago
- Replication utility for AWS Glue Data Catalog☆78Updated 8 months ago
- ☆13Updated 8 months ago
- ☆17Updated 9 months ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆25Updated 6 years ago
- ☆47Updated last year
- ☆26Updated 10 months ago
- ☆30Updated 10 months ago
- ☆34Updated 2 years ago
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆27Updated last week
- Workshop and lab content for Amazon Aurora MySQL compatible databases. This code will contain a series of templates, instructional guides…☆79Updated 11 months ago