angelmaroco / spark-on-aws-eks-with-karpenter
WIP - Scaling Spark Data Platform with EKS. The solution uses Karpenter and Cluster Autoscaler, Yunikorn for advanced scheduling.
☆13Updated 2 years ago
Alternatives and similar repositories for spark-on-aws-eks-with-karpenter
Users that are interested in spark-on-aws-eks-with-karpenter are comparing it to the libraries listed below
Sorting:
- Helm Chart for deploying Spark history server in Amazon EKS for S3 Spark Event Logs☆19Updated last week
- Helm charts for Trino and Trino Gateway☆165Updated 2 weeks ago
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆690Updated 7 months ago
- Examples and custom spark images for working with the spark-on-k8s operator on AWS☆26Updated 4 years ago
- Docker image for running Spark 3 on Kubernetes on AWS☆27Updated 3 years ago
- Apache Spark Kubernetes Operator☆141Updated last week
- Grafana dashboards and StatsD exporter config for Airflow monitoring☆277Updated last year
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆185Updated last month
- A Helm chart to install Apache Airflow on Kubernetes☆283Updated last week
- ☆53Updated last week
- Apache Druid On Kubernetes☆109Updated 2 weeks ago
- DoEKS is a tool to build, deploy and scale Data & ML Platforms on Amazon EKS☆745Updated this week
- A Python package to submit and manage Apache Spark applications on Kubernetes.☆41Updated last month
- A terraform module that creates an airflow instance in AWS ECS.☆61Updated last year
- ☆198Updated this week
- A provider package for kafka☆37Updated last year
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆235Updated last month
- ☆10Updated 3 months ago
- GitHub Actions to Validate DAGs, Variables and Dependencies upon Pull Request☆22Updated last year
- UI For Apache Kafka Helm Charts☆31Updated 8 months ago
- Performance optimization for Spark running on Kubernetes☆88Updated 4 years ago
- Terraform Provider for Airbyte API☆55Updated this week
- The athena adapter plugin for dbt (https://getdbt.com)☆249Updated 3 months ago
- Spark on Kubernetes infrastructure Helm charts repo☆201Updated 2 years ago
- Performance Observability for Apache Spark☆249Updated last month
- ☆39Updated 4 years ago
- dbt + Trino demo project, using TPC-H sample data☆19Updated last year
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆66Updated 3 years ago
- Spark history server Helm Chart☆20Updated last year
- Druid Kubernetes Operator☆205Updated 11 months ago