aws / aws-emr-best-practicesLinks
A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational excellence, reliability and application specific best practices across Spark, Hive, Hudi, Hbase and more.
☆110Updated 3 months ago
Alternatives and similar repositories for aws-emr-best-practices
Users that are interested in aws-emr-best-practices are comparing it to the libraries listed below
Sorting:
- Example code for running Spark and Hive jobs on EMR Serverless.☆168Updated last year
- ☆42Updated 3 weeks ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆90Updated 3 years ago
- Spark runtime on AWS Lambda☆113Updated 5 months ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆227Updated 10 months ago
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆67Updated last week
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆39Updated 11 months ago
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆46Updated last year
- Performant Redshift data source for Apache Spark☆141Updated 2 weeks ago
- This repository contains the dbt-glue adapter☆139Updated 3 weeks ago
- ☆72Updated last year
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 3 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆77Updated 7 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated 2 years ago
- Example applications in Java, Python and SQL for Kinesis Data Analytics, demonstrating sources, sinks, and operators.☆147Updated last year
- The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by maki…☆201Updated 2 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated 2 years ago
- ☆89Updated 2 years ago
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated 2 years ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆118Updated 2 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated 2 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 3 years ago
- Spark Structured Streaming Kinesis Data Streams connector supports both GetRecords and SubscribeToShard (Enhanced Fan-Out, EFO)☆39Updated this week
- ☆54Updated 2 years ago
- ☆75Updated 2 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆31Updated 2 years ago
- Replication utility for AWS Glue Data Catalog☆79Updated last year
- Collection of code examples for Amazon Managed Service for Apache Flink☆86Updated 2 weeks ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆696Updated 3 weeks ago
- A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficie…☆248Updated this week