Controller for ModelMesh
☆243Updated this week
Alternatives and similar repositories for modelmesh-serving
Users that are interested in modelmesh-serving are comparing it to the libraries listed below
Sorting:
- Distributed Model Serving Framework☆187Sep 30, 2025Updated 5 months ago
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆22Updated this week
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆5,135Updated this week
- User documentation for KServe.☆109Updated this week
- KServe models web UI☆47Feb 18, 2026Updated last week
- ModelMesh Performance Scripts, Dashboard and Pipelines☆12May 12, 2025Updated 9 months ago
- KServe community docs for contributions and process☆15Feb 21, 2026Updated last week
- ☆17Updated this week
- An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more☆875Updated this week
- Docker for Your ML/DL Models Based on OCI Artifacts☆474Jan 26, 2024Updated 2 years ago
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆165Updated this week
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆11Apr 1, 2020Updated 5 years ago
- Backend server for envd☆22Dec 18, 2023Updated 2 years ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,393Updated this week
- ☆14Jul 25, 2025Updated 7 months ago
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models☆4,730Feb 16, 2026Updated 2 weeks ago
- KServe V2 Protocol Rest API Implementation Proxy☆13Updated this week
- Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine☆216Sep 22, 2025Updated 5 months ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆516Feb 23, 2026Updated last week
- Cloud Native ML/DL Platform☆133Sep 9, 2020Updated 5 years ago
- NVIDIA device plugin for Kubernetes☆15Sep 9, 2019Updated 6 years ago
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,549Updated this week
- NVIDIA device plugin for Kubernetes☆3,671Updated this week
- Automated Machine Learning on Kubernetes☆1,660Updated this week
- Kubernetes-native Job Queueing☆2,329Updated this week
- Kubeflow Pipelines on Tekton☆182Nov 19, 2024Updated last year
- RDMA CNI plugin for containerized workloads☆59Feb 15, 2026Updated 2 weeks ago
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.☆55Jul 27, 2022Updated 3 years ago
- Gateway API Inference Extension☆594Updated this week
- Golang libraries for multi-cluster-aware Kubernetes clients, listers and informers.☆21Feb 23, 2026Updated last week
- Cloud Native Machine Learning Model Registry☆82Jan 12, 2023Updated 3 years ago
- Repository for open inference protocol specification☆64May 12, 2025Updated 9 months ago
- Repository for out-of-tree scheduler plugins based on scheduler framework.☆1,276Dec 5, 2025Updated 2 months ago
- A Cloud Native Batch System (Project under CNCF)☆5,340Updated this week
- Automatic tuning for ML model deployment on Kubernetes☆80Nov 1, 2024Updated last year
- Helm charts☆21Updated this week
- A toolkit to run Ray applications on Kubernetes☆2,341Feb 23, 2026Updated last week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆673Updated this week
- ACK service controller for Amazon Application AutoScaling☆14Jan 8, 2026Updated last month