A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational excellence, reliability and application specific best practices across Spark, Hive, Hudi, Hbase and more.
☆110Feb 2, 2026Updated last month
Alternatives and similar repositories for aws-emr-best-practices
Users that are interested in aws-emr-best-practices are comparing it to the libraries listed below
Sorting:
- ☆42Updated this week
- ☆23Feb 14, 2025Updated last year
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆39Feb 17, 2025Updated last year
- This repository contains the dbt-glue adapter☆142Updated this week
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆29Dec 22, 2020Updated 5 years ago
- ☆13Feb 26, 2024Updated 2 years ago
- Application to securely map users on a multi tenant Amazon EMR cluster to different IAM Roles and then assume the mapped Role.☆24Oct 24, 2023Updated 2 years ago
- Amazon EMR on EKS Custom Image CLI☆32Sep 26, 2024Updated last year
- Analyzing NBA Data☆11Feb 19, 2015Updated 11 years ago
- An Apache Spark Structured Streaming S3 connector for reading S3 files using Amazon S3 event notifications to AWS SQS☆15Feb 13, 2024Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Oct 31, 2023Updated 2 years ago
- ☆18Nov 4, 2024Updated last year
- This tool can easily make / build an emr cluster edge node / client node / gateway node☆10Jun 1, 2022Updated 3 years ago
- ☆32Jan 30, 2026Updated last month
- The dbt-spark-livy adapter allows you to use dbt along with Apache Spark, by connecting via Apache Livy☆12Mar 30, 2023Updated 2 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Dec 5, 2023Updated 2 years ago
- ☆22Nov 4, 2025Updated 4 months ago
- Spark Structured Streaming Kinesis Data Streams connector supports both GetRecords and SubscribeToShard (Enhanced Fan-Out, EFO)☆39Mar 2, 2026Updated last week
- ☆12May 18, 2019Updated 6 years ago
- Deploy Jupyter Notebook to AWS Lambda☆16Nov 18, 2020Updated 5 years ago
- This solution combines Amazon Pinpoint with Amazon SageMaker to help automate the process of collecting customer data, predicting custom…☆17Dec 17, 2020Updated 5 years ago
- Mirror of Apache Ranger☆15Apr 5, 2024Updated last year
- ☆25Jul 4, 2023Updated 2 years ago
- ☆20Mar 6, 2025Updated last year
- ☆23Sep 3, 2024Updated last year
- Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR☆17Apr 27, 2025Updated 10 months ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆26Sep 10, 2024Updated last year
- ☆22Oct 18, 2023Updated 2 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆169Jan 8, 2025Updated last year
- The open source version of the Amazon EMR Release Guide. You can submit feedback & requests for changes by submitting issues in this repo…☆29Jun 15, 2023Updated 2 years ago
- Build and automatize the management of your Sagemaker Studio Users using AWS CDK!☆23Apr 5, 2022Updated 3 years ago
- Scripts and instructions to facilitate running Deep Learning Tasks on Amazon EMR☆63Nov 9, 2023Updated 2 years ago
- This Guidance demonstrates how you can automate your carbon footprint tracking with the Sustainability Insights Framework (SIF) on AWS☆29Oct 20, 2024Updated last year
- ☆75Jun 8, 2023Updated 2 years ago
- ☆27Aug 8, 2024Updated last year
- An attribute macro that logs the function return value☆37Dec 11, 2025Updated 2 months ago
- AWS Label Module☆40Aug 20, 2025Updated 6 months ago
- Python API for Deequ☆813Updated this week
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week