developerhq / spark-kubernetesLinks
Deploy your Spark Production Cluster on Kubernetes
☆47Updated 4 years ago
Alternatives and similar repositories for spark-kubernetes
Users that are interested in spark-kubernetes are comparing it to the libraries listed below
Sorting:
- spark on kubernetes☆104Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Interactive Notebooks that support the book☆40Updated 4 years ago
- The Internals of Spark on Kubernetes☆71Updated 3 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- ☆24Updated 8 months ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆98Updated 2 years ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆51Updated 4 years ago
- Sample processing code using Spark 2.1+ and Scala☆52Updated 4 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago
- ☆21Updated last year
- Spark on Kubernetes infrastructure Helm charts repo☆203Updated 2 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Updated 2 years ago
- Bootstrap a pipeline on the BDE platform☆26Updated 8 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- This repository contains recipes for Apache Pinot.☆30Updated 3 months ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Takes a kafka stream into spark, apply transformations and sink into Druid. Everything Dockerised.☆30Updated last year
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated last year
- Docker image for Apache Hive Metastore☆71Updated 2 years ago
- Performance optimization for Spark running on Kubernetes☆89Updated 4 years ago
- ☆24Updated 4 years ago
- ☆63Updated 5 years ago
- Spark cloud integration: tests, cloud committers and more☆19Updated 4 months ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆75Updated 2 years ago
- ☆26Updated 4 years ago