stijndehaes / pyspark-k8s-exampleLinks
☆25Updated 6 years ago
Alternatives and similar repositories for pyspark-k8s-example
Users that are interested in pyspark-k8s-example are comparing it to the libraries listed below
Sorting:
- Spark on Kubernetes infrastructure Helm charts repo☆204Updated 2 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆286Updated this week
- A simple spark standalone cluster for your testing environment purposses☆573Updated last year
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆481Updated last week
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆134Updated 2 years ago
- ☆127Updated 5 years ago
- A guide to running Airflow on Kubernetes☆173Updated 6 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆345Updated last year
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆699Updated 11 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Updated 2 years ago
- Airflow Backfill UI based plugin for existing / new Airflow environment☆65Updated 4 years ago
- ☆267Updated 11 months ago
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆495Updated 2 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 3 months ago
- Grafana dashboards and StatsD exporter config for Airflow monitoring☆286Updated last year
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆786Updated last week
- Orchestrate Spark Jobs from Kubeflow Pipelines and poll for the status.☆52Updated 3 years ago
- REST API for Apache Spark on K8S or YARN☆104Updated 3 weeks ago
- spark on kubernetes☆104Updated 2 years ago
- Multiple node presto cluster on docker container☆125Updated 3 years ago
- ☆40Updated 4 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆121Updated 4 years ago
- Docker image for running Spark 3 on Kubernetes on AWS☆26Updated 4 years ago
- A boilerplate for writing PySpark Jobs☆394Updated last year
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆38Updated 4 years ago
- Spark on Kubernetes using Helm☆34Updated 5 years ago
- Joblib Apache Spark Backend☆249Updated 5 months ago
- PySpark test helper methods with beautiful error messages☆714Updated last week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆413Updated 4 months ago