aws / aws-emr-best-practicesLinks
A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational excellence, reliability and application specific best practices across Spark, Hive, Hudi, Hbase and more.
☆107Updated 2 months ago
Alternatives and similar repositories for aws-emr-best-practices
Users that are interested in aws-emr-best-practices are comparing it to the libraries listed below
Sorting:
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆64Updated 3 weeks ago
- ☆40Updated 2 months ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆164Updated 4 months ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆85Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- ☆73Updated last year
- Spark ETL example processing New York taxi rides public dataset on EKS☆45Updated 2 years ago
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆43Updated last year
- Spark runtime on AWS Lambda☆107Updated 8 months ago
- This repository contains the dbt-glue adapter☆123Updated this week
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆37Updated 3 months ago
- ☆24Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated last year
- Replication utility for AWS Glue Data Catalog☆78Updated 9 months ago
- ☆89Updated last year
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆222Updated 2 months ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- Performant Redshift data source for Apache Spark☆140Updated last month
- An open-source framework that simplifies implementation of data solutions.☆137Updated this week
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 2 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆116Updated 6 months ago
- Samples to help you get started with the Amazon Redshift Data API☆73Updated last year
- ☆158Updated last year
- ☆73Updated last year
- ☆13Updated 9 months ago
- Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR☆18Updated last month
- Reference Architectures for Datalakes on AWS☆79Updated 5 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago