developerhq / spark-kubernetes
Deploy your Spark Production Cluster on Kubernetes
☆47Updated 4 years ago
Alternatives and similar repositories for spark-kubernetes:
Users that are interested in spark-kubernetes are comparing it to the libraries listed below
- spark on kubernetes☆105Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Examples of Spark 3.0☆46Updated 4 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- ☆25Updated 5 months ago
- Interactive Notebooks that support the book☆39Updated 4 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Updated last year
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Ambari stack service for installing and managing Apache Airflow on HDP cluster☆59Updated 6 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 4 years ago
- Docker Image for Kudu☆38Updated 5 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆198Updated 2 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆99Updated 2 years ago
- ☆24Updated 4 years ago
- This project has customization likes custom data sources, plugins written for the distributed systems like Apache Spark, Apache Ignite et…☆33Updated last year
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Running Presto on k8s☆38Updated 5 years ago
- Takes a kafka stream into spark, apply transformations and sink into Druid. Everything Dockerised.☆30Updated last year
- ☆47Updated 6 months ago
- HDFS inotify Example☆22Updated 2 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- Performance optimization for Spark running on Kubernetes☆86Updated 4 years ago
- CSD for Apache Airflow☆20Updated 5 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Apache Spark ETL Utilities☆40Updated 3 months ago
- ☆40Updated last year
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago