kserve / modelmesh-runtime-adapter
Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
☆21Updated 3 weeks ago
Alternatives and similar repositories for modelmesh-runtime-adapter:
Users that are interested in modelmesh-runtime-adapter are comparing it to the libraries listed below
- Distributed Model Serving Framework☆159Updated 4 months ago
- Controller for ModelMesh☆219Updated last month
- Repository for open inference protocol specification☆46Updated 6 months ago
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆89Updated this week
- ☆105Updated this week
- Kubeflow Pipelines on Tekton☆177Updated 3 months ago
- User documentation for KServe.☆104Updated this week
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆27Updated 2 months ago
- Holistic job manager on Kubernetes☆111Updated 11 months ago
- MLFlow Deployment Plugin for Ray Serve☆43Updated 2 years ago
- JobSet: a k8s native API for distributed ML training and HPC workloads☆187Updated this week
- GenAI inference performance benchmarking tool☆17Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆82Updated this week
- Argoflow has been superseded by deployKF☆136Updated last year
- A repository for Open Data Hub Kustomize manifests extending upstream Kubeflow manifests☆62Updated last year
- Seldon Core Operator for Kubernetes☆12Updated 5 years ago
- ☆34Updated this week
- ☆29Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆59Updated 2 months ago
- Fybrik☆132Updated last year
- ModelMesh Performance Scripts, Dashboard and Pipelines☆11Updated 2 years ago
- KAR: A Runtime for the Hybrid Cloud☆29Updated 5 months ago
- ☆101Updated this week
- ☆34Updated 2 weeks ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆57Updated this week
- Open Data Hub operator to manage ODH component integrations☆69Updated this week
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆202Updated 2 months ago
- Machine Learning Inference Graph Spec☆21Updated 5 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆61Updated 3 weeks ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆69Updated this week