Alternatives and similar repositories for open-inference-protocol:

Users that are interested in open-inference-protocol are comparing it to the libraries listed below

• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆217Updated last month
• kserve / website
  User documentation for KServe.
  ☆104Updated this week
• terrytangyuan / awesome-kubeflow
  A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)
  ☆202Updated 2 months ago
• kubeflow / model-registry
  ☆104Updated this week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆159Updated 4 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆89Updated this week
• kubeflow / kfp-tekton
  Kubeflow Pipelines on Tekton
  ☆176Updated 2 months ago
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆186Updated this week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆82Updated this week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆231Updated this week
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆111Updated 11 months ago
• kserve / modelmesh-runtime-adapter
  Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
  ☆21Updated 3 weeks ago
• NVIDIA / nvkind
  ☆101Updated this week
• cnvrg / metagpu
  K8s device plugin for GPU sharing
  ☆99Updated last year
• argoflow / argoflow
  Argoflow has been superseded by deployKF
  ☆136Updated last year
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆16Updated this week
• mlspec / MLSpec
  Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…
  ☆91Updated 10 months ago
• iter8-tools / iter8
  Kubernetes release optimizer
  ☆256Updated 6 months ago
• kubeflow / kfctl
  kfctl is a CLI for deploying and managing Kubeflow
  ☆183Updated last year
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆84Updated last year
• NVIDIA / k8s-dra-driver-gpu
  Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes
  ☆312Updated this week
• llmnetes / llmnetes
  ☆49Updated 11 months ago
• kserve / models-web-app
  KServe models web UI
  ☆36Updated this week
• SeldonIO / seldon-operator
  Seldon Core Operator for Kubernetes
  ☆12Updated 5 years ago
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆38Updated this week
• awslabs / aws-virtual-gpu-device-plugin
  AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads
  ☆203Updated last year
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆43Updated 2 years ago
• coreweave / ml-containers
  ☆27Updated this week
• arrikto / oidc-authservice
  This is a fork/refactoring of the ajmyyra/ambassador-auth-oidc project
  ☆88Updated 10 months ago
• fybrik / fybrik
  Fybrik
  ☆132Updated last year