angelmaroco / spark-on-aws-eks-with-karpenter
WIP - Scaling Spark Data Platform with EKS. The solution uses Karpenter and Cluster Autoscaler, Yunikorn for advanced scheduling.
☆12Updated last year
Alternatives and similar repositories for spark-on-aws-eks-with-karpenter:
Users that are interested in spark-on-aws-eks-with-karpenter are comparing it to the libraries listed below
- Helm Chart for deploying Spark history server in Amazon EKS for S3 Spark Event Logs☆19Updated 7 months ago
- Examples and custom spark images for working with the spark-on-k8s operator on AWS☆27Updated 4 years ago
- Project to concentrate files and settings for AWS EMR monitoring. Source: https://aws.amazon.com/blogs/big-data/monitor-and-optimize-anal…☆13Updated 6 months ago
- A terraform module that creates an airflow instance in AWS ECS.☆61Updated last year
- Built on Mountpoint for Amazon S3, the Mountpoint CSI driver presents an Amazon S3 bucket as a storage volume accessible by containers in…☆283Updated this week
- Terraform provider for managing Snowflake accounts☆602Updated this week
- Reduce the boot time of containers with large images by caching the images in the data volume of Bottlerocket OS.☆36Updated last week
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆182Updated last week
- The athena adapter plugin for dbt (https://getdbt.com)☆249Updated 2 months ago
- DoEKS is a tool to build, deploy and scale Data & ML Platforms on Amazon EKS☆738Updated last week
- Docker image for running Spark 3 on Kubernetes on AWS☆27Updated 3 years ago
- Helm charts for Trino and Trino Gateway☆162Updated last week
- Apache Druid On Kubernetes☆108Updated 3 weeks ago
- Spark history server Helm Chart☆20Updated last year
- This provider contains operators, decorators and triggers to send a ray job from an airflow task☆18Updated last month
- Karpenter Blueprints is a list of common workload scenarios following best practices. You'll find here details of why configuring the Kar…☆262Updated 2 months ago
- ☆20Updated 2 months ago
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆690Updated 6 months ago
- A Helm chart to install Apache Airflow on Kubernetes☆281Updated this week
- Grafana dashboards and StatsD exporter config for Airflow monitoring☆275Updated last year
- AWS Provider for Crossplane.☆169Updated this week
- Run sqlfluff with reviewdog to check or format styles☆69Updated 2 weeks ago
- Terraform module to create AWS EKS Pod Identity resources 🇺🇦☆77Updated last month
- ☆19Updated last year
- This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …☆16Updated 3 years ago
- Terraform module to create AWS MSK (Managed Streaming for Kafka) resources 🇺🇦☆58Updated this week
- The platform that powers Airbyte. Please file issues in https://github.com/airbytehq/airbyte☆241Updated this week
- Trino Group Provider LDAP is a Trino (formerly Presto SQL) plugin to map user names to groups using an LDAP server☆21Updated last year
- Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows☆23Updated 8 months ago
- Terraform module which provisions addons on Amazon EKS clusters☆323Updated last month