apache-spark-on-k8s / spark
Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
☆612Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for spark
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆398Updated last month
- Running YARN on Kubernetes with PetSet controller.☆166Updated 6 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆658Updated 2 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆175Updated last year
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 4 years ago
- Docker image with Ambari☆291Updated 6 years ago
- Kubernetes operator that provides control plane for managing Apache Flink applications☆569Updated 2 months ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆241Updated 9 years ago
- A Kafka Operator for Kubernetes☆297Updated 6 years ago
- Mirror of Apache Bahir☆337Updated last year
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆2,788Updated this week
- Apache Kafka on Apache Mesos☆414Updated 6 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆176Updated 2 years ago
- Used to build the mesosphere/spark docker image and the DC/OS Spark package☆52Updated 3 years ago
- Kubernetes Director (aka KubeDirector) for deploying and managing stateful applications on Kubernetes☆400Updated last year
- Docker packaging for Apache Flink☆140Updated 4 years ago
- Schema Registry☆15Updated 4 months ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,010Updated 2 years ago
- Docker build for Apache Spark☆676Updated 2 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Benchmark Suite for Apache Spark☆238Updated last year
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆886Updated last month
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆156Updated 2 years ago
- Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...☆632Updated 10 months ago
- Performance optimization for Spark running on Kubernetes☆85Updated 4 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated 2 years ago