aws / aws-emr-best-practices
A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational excellence, reliability and application specific best practices across Spark, Hive, Hudi, Hbase and more.
☆103Updated 3 months ago
Alternatives and similar repositories for aws-emr-best-practices:
Users that are interested in aws-emr-best-practices are comparing it to the libraries listed below
- Example code for running Spark and Hive jobs on EMR Serverless.☆161Updated last month
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆62Updated this week
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated last year
- ☆40Updated 5 months ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆211Updated 9 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- Replication utility for AWS Glue Data Catalog☆75Updated 6 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆30Updated 2 weeks ago
- This repository contains the dbt-glue adapter☆109Updated this week
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆50Updated last year
- Spark runtime on AWS Lambda☆106Updated 5 months ago
- ☆88Updated last year
- Performant Redshift data source for Apache Spark☆138Updated last month
- ☆68Updated 9 months ago
- ☆24Updated 11 months ago
- ☆53Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- Constructs to deploy airflow via the aws cdk☆27Updated 4 years ago
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆41Updated 9 months ago
- ☆158Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆24Updated 6 months ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆112Updated 3 months ago
- An open-source framework that simplifies implementation of data solutions.☆124Updated this week
- The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by maki…☆198Updated last year
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- ☆25Updated last year