kserve / modelmesh-runtime-adapter
Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
☆21Updated last week
Alternatives and similar repositories for modelmesh-runtime-adapter:
Users that are interested in modelmesh-runtime-adapter are comparing it to the libraries listed below
- Distributed Model Serving Framework☆159Updated last week
- Repository for open inference protocol specification☆50Updated 8 months ago
- Controller for ModelMesh☆225Updated 3 weeks ago
- User documentation for KServe.☆104Updated this week
- ☆107Updated this week
- Argoflow has been superseded by deployKF☆137Updated last year
- Kubeflow Pipelines on Tekton☆178Updated 4 months ago
- Seldon Core Operator for Kubernetes☆12Updated 5 years ago
- GenAI inference performance benchmarking tool☆20Updated this week
- Holistic job manager on Kubernetes☆112Updated last year
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆88Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆89Updated this week
- KServe V2 Protocol Rest API Implementation Proxy☆10Updated last week
- Machine Learning Inference Graph Spec☆21Updated 5 years ago
- ☆40Updated this week
- A top-like tool for monitoring GPUs in a cluster☆86Updated last year
- Incubating project for xgboost operator☆76Updated 3 years ago
- ☆30Updated last week
- ☆37Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆194Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated 3 months ago
- ForestFlow is a policy-driven Machine Learning Model Server. It is an LF AI Foundation incubation project.☆73Updated last year
- ☆112Updated last week
- Fybrik☆132Updated last year
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆27Updated 3 months ago
- MLFlow Deployment Plugin for Ray Serve☆44Updated 2 years ago
- Repository to hold code, instructions, demos and pointers to presentation assets for Kubeflow Dojo☆135Updated 2 years ago
- KAR: A Runtime for the Hybrid Cloud☆29Updated 6 months ago
- KServe models web UI☆36Updated this week
- Open Data Hub operator to manage ODH component integrations☆73Updated this week