sbakiu / kubeflow-spark
Orchestrate Spark Jobs from Kubeflow Pipelines and poll for the status.
☆52Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for kubeflow-spark
- Materials of the Official Helm Chart Webinar☆27Updated 3 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆43Updated 9 months ago
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated 2 years ago
- Example repo to kickstart integration with mlflow pipelines.☆73Updated 2 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- spark on kubernetes☆105Updated last year
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆53Updated 2 months ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- PySpark data-pipeline testing and CICD☆28Updated 4 years ago
- Performance optimization for Spark running on Kubernetes☆85Updated 4 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆163Updated last week
- End to End example integrating MLFlow and Seldon Core☆51Updated 4 years ago
- A workshop with several modules to help learn Feast, an open-source feature store☆84Updated 2 months ago
- Magic to help Spark pipelines upgrade☆34Updated last month
- Delta lake and filesystem helper methods☆49Updated 8 months ago
- Python - Java/Scala API for the Hopsworks feature store☆53Updated last week
- JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook☆92Updated last year
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- 🚀 Deploy Kubeflow on AWS EKS with Terraform 🤖☆64Updated last year
- demo CI/CD pipeline using MLRun, Kubeflow and GitHub Actions☆49Updated 2 years ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Kubeflow example of machine learning/model serving☆35Updated 4 years ago
- ☆54Updated 10 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Deploy production-grade Metaflow cloud infrastructure on AWS☆58Updated 3 months ago
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 4 months ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆189Updated last week
- REST API for Apache Spark on K8S or YARN☆92Updated this week