developerhq / spark-kubernetesLinks
Deploy your Spark Production Cluster on Kubernetes
☆47Updated 4 years ago
Alternatives and similar repositories for spark-kubernetes
Users that are interested in spark-kubernetes are comparing it to the libraries listed below
Sorting:
- spark on kubernetes☆104Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆75Updated 2 years ago
- ☆25Updated 10 months ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last month
- The Internals of Spark on Kubernetes☆71Updated 3 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆99Updated 2 years ago
- This repository contains recipes for Apache Pinot.☆30Updated 4 months ago
- Multiple node presto cluster on docker container☆123Updated 3 years ago
- Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.☆64Updated last year
- ☆63Updated 5 years ago
- Spark on Kubernetes using Helm☆34Updated 5 years ago
- Apache Flink (Pyflink) and Related Projects☆40Updated 3 months ago
- Performance optimization for Spark running on Kubernetes☆89Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 6 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 5 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 5 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- A tool to create Airflow RBAC roles with dag-level permissions from cli.☆13Updated last year
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- ☆58Updated 11 months ago
- Code for the deployment of Hadoop clusters, written in Bourne or Bourne Again shell.☆34Updated last year
- A Spark metrics sink that pushes to InfluxDb☆51Updated 4 years ago
- ☆40Updated 2 years ago
- Jupyter Integration for Flink SQL via Ververica Platform☆43Updated last year