Alternatives and similar repositories for llm-d-benchmark

Users that are interested in llm-d-benchmark are comparing it to the libraries listed below

• rh-aiservices-bu / gpu-partitioning-guide
  Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others
  ☆42Updated 8 months ago
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆38Updated this week
• vllm-project / vllm-spyre
  Community maintained hardware plugin for vLLM on Spyre
  ☆26Updated this week
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆57Updated this week
• llm-d / llm-d-model-service
  Simplified model deployment on llm-d
  ☆24Updated 3 weeks ago
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆39Updated last month
• openshift-psap / topsail
  Test Orchestrator for Performance and Scalability of AI pLatforms
  ☆15Updated this week
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆43Updated this week
• IBM / trusted-service-identity
  Trusted Service Identity is closing the gap of preventing access to secrets by an untrusted operator during the process of obtaining auth…
  ☆27Updated last month
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆38Updated 2 weeks ago
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆17Updated last week
• migtools / mig-controller
  OpenShift Migration Controller
  ☆22Updated this week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆28Updated 6 months ago
• IBM / raksh
  Seamlessly use VM based TEEs with Kubernetes for data-in use protection
  ☆36Updated 3 years ago
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆27Updated this week
• opendatahub-io / ai-edge
  ODH integration with AI at the Edge usecases
  ☆12Updated 7 months ago
• llm-d / llm-d-inference-sim
  A light weight vLLM simulator, for mocking out replicas.
  ☆26Updated this week
• intel / intel-technology-enabling-for-openshift
  The project delivers a comprehensive full-stack solution for the Intel® Enterprise AI Foundation on the OpenShift platform to provision I…
  ☆20Updated 3 weeks ago
• rh-ecosystem-edge / kernel-module-management
  The kernel module management operator builds, signs and loads kernel modules on OpenShift.
  ☆28Updated this week
• red-hat-storage / ocs-operator
  Operator for RHOCS
  ☆86Updated this week
• containers / nri-plugins
  A collection of community maintained NRI plugins
  ☆83Updated this week
• RamenDR / ramen
  ☆87Updated this week
• intel / platform-aware-scheduling
  Enabling Kubernetes to make pod placement decisions with platform intelligence.
  ☆175Updated 4 months ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆58Updated last week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆69Updated this week
• openshift-psap / llm-load-test
  ☆43Updated 3 months ago
• NVIDIA / doca-platform
  DOCA Platform manages provisioning and service orchestration for Bluefield DPUs
  ☆42Updated last month
• open-cluster-management-io / community
  open-cluster-management governance material.
  ☆64Updated 3 months ago
• caikit / caikit-nlp
  ☆12Updated last month
• openshift / ci-tools
  DPTP Tooling
  ☆46Updated this week