Alternatives and similar repositories for open-inference-protocol:

Users that are interested in open-inference-protocol are comparing it to the libraries listed below

• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆213Updated last week
• kserve / website
  User documentation for KServe.
  ☆103Updated this week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆156Updated 3 months ago
• kubeflow / model-registry
  ☆97Updated this week
• terrytangyuan / awesome-kubeflow
  A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)
  ☆198Updated last month
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆167Updated this week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆168Updated this week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆74Updated this week
• kubeflow / kfp-tekton
  Kubeflow Pipelines on Tekton
  ☆175Updated last month
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆86Updated this week
• kserve / modelmesh-runtime-adapter
  Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
  ☆21Updated last month
• cnvrg / metagpu
  K8s device plugin for GPU sharing
  ☆99Updated last year
• kubeflow / kfctl
  kfctl is a CLI for deploying and managing Kubeflow
  ☆182Updated last year
• mlspec / MLSpec
  Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…
  ☆91Updated 9 months ago
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆110Updated 10 months ago
• argoflow / argoflow
  Argoflow has been superseded by deployKF
  ☆136Updated last year
• NVIDIA / nvkind
  ☆95Updated 3 weeks ago
• SeldonIO / tempo
  MLOps Python Library
  ☆117Updated 2 years ago
• awslabs / aws-virtual-gpu-device-plugin
  AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads
  ☆203Updated last year
• kserve / models-web-app
  KServe models web UI
  ☆35Updated 4 months ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆10Updated this week
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆83Updated 11 months ago
• iter8-tools / iter8
  Kubernetes release optimizer
  ☆256Updated 5 months ago
• kubeflow / mpi-operator
  Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)
  ☆451Updated this week
• fybrik / fybrik
  Fybrik
  ☆131Updated last year
• NVIDIA / k8s-dra-driver
  Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes
  ☆301Updated this week
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆43Updated 2 years ago
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆33Updated this week