aws / aws-emr-best-practices
A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational excellence, reliability and application specific best practices across Spark, Hive, Hudi, Hbase and more.
☆103Updated last month
Alternatives and similar repositories for aws-emr-best-practices:
Users that are interested in aws-emr-best-practices are comparing it to the libraries listed below
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆62Updated 3 weeks ago
- ☆38Updated 3 months ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆160Updated 3 weeks ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆30Updated 4 months ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆23Updated 5 months ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆49Updated last year
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- ☆67Updated 7 months ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆210Updated 8 months ago
- ☆87Updated last year
- Spark runtime on AWS Lambda☆105Updated 4 months ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- This repository contains the dbt-glue adapter☆107Updated last week
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆61Updated last year
- ☆23Updated 10 months ago
- Samples to help you get started with the Amazon Redshift Data API☆73Updated last year
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆41Updated 8 months ago
- ☆53Updated last year
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆48Updated 2 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated last year
- Amazon Managed Service for Apache Flink Benchmarking Utility helps with capacity planning, integration testing, and benchmarking of Amazo…☆20Updated last year
- Replication utility for AWS Glue Data Catalog☆75Updated 5 months ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆42Updated last month
- ☆60Updated 3 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆67Updated 2 years ago
- ☆34Updated 2 years ago
- The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by maki…☆198Updated last year