krisnova / spark-cluster-api-operator
Use Kubernetes to autoscale your spark clusters.
☆10Updated 5 years ago
Alternatives and similar repositories for spark-cluster-api-operator:
Users that are interested in spark-cluster-api-operator are comparing it to the libraries listed below
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 4 months ago
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Twitter Streaming API Example with Kafka Streams in Scala☆49Updated 8 years ago
- Minikube for big data with Scala and Spark☆15Updated 5 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 6 years ago
- An umbrella project for multiple implementations of model serving☆46Updated 7 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆135Updated 2 years ago
- A Giter8 template for scio☆30Updated 2 months ago
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Apache Zeppelin on Kubernetes.☆28Updated 5 years ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- ☆54Updated 7 years ago
- A tutorial on Apache Spark Unit Testing☆37Updated 8 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago
- Kafka Streams + Memcached (e.g. AWS ElasticCache) for low-latency in-memory lookups☆13Updated 5 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- All Data, Relevant Information, Scripts, and Applications for the Open Data Science Conference (2018)☆11Updated 6 years ago
- ☆106Updated 2 years ago
- Apache Airflow CI pipeline☆18Updated 5 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌