Alternatives and similar repositories for llm-d-model-service

Users that are interested in llm-d-model-service are comparing it to the libraries listed below

• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆56Updated this week
• kubernetes-sigs / dra-example-driver
  Example DRA driver that developers can fork and modify to get them started writing their own.
  ☆74Updated 3 weeks ago
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆38Updated this week
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆116Updated last year
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆55Updated 2 weeks ago
• stolostron / multicloud-operators-foundation
  ☆55Updated this week
• operator-framework / rukpak
  RukPak runs in a Kubernetes cluster and defines APIs for installing cloud native content
  ☆51Updated 10 months ago
• open-cluster-management-io / community
  open-cluster-management governance material.
  ☆64Updated 3 months ago
• kubernetes-sigs / node-feature-discovery-operator
  Operator for managing Node Feature Discovery deployment
  ☆70Updated 3 weeks ago
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆129Updated this week
• kubernetes-sigs / work-api
  Kubernetes Work API
  ☆66Updated last month
• knative-extensions / kperf
  A benchmarking tool to evaluate Knative performance
  ☆38Updated last year
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆94Updated 2 months ago
• knative-extensions / sample-controller
  A template project for writing your own controller using the Knative helper libraries.
  ☆73Updated this week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆28Updated 6 months ago
• project-codeflare / appwrapper
  AppWrapper controller for Kueue
  ☆14Updated last week
• open-cluster-management-io / registration
  hub / spoke registration controllers
  ☆42Updated 8 months ago
• kubernetes / dynamic-resource-allocation
  ☆37Updated this week
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆42Updated this week
• kubernetes-sigs / kjob
  KJob: Tool for CLI-loving ML researchers
  ☆30Updated last week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆63Updated this week
• kubernetes-sigs / kernel-module-management
  The kernel module management operator builds, signs and loads kernel modules in Kubernetes clusters.
  ☆103Updated last week
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆34Updated 2 weeks ago
• kubestellar / kubestellar
  KubeStellar - a flexible solution for multi-cluster configuration management for edge, multi-cloud, and hybrid cloud
  ☆413Updated this week
• kubernetes-sigs / wg-serving
  WG Serving
  ☆27Updated last week
• kubernetes-retired / container-object-storage-interface-csi-adapter
  CSI driver to bootstrap COSI workloads
  ☆18Updated 2 years ago
• kubernetes-sigs / apiserver-runtime
  Libraries for implementing aggregated apiservers
  ☆90Updated 2 months ago
• containers / nri-plugins
  A collection of community maintained NRI plugins
  ☆82Updated this week
• kubernetes-retired / container-object-storage-interface-api
  Container Object Storage Interface (COSI) API responsible to define API for COSI objects. NOTE: The content of this repo has been moved t…
  ☆70Updated 6 months ago
• elastic / crd-ref-docs
  Generates Kubernetes CRD API reference documentation
  ☆133Updated last week