Alternatives and similar repositories for GenAIInfra:

Users that are interested in GenAIInfra are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆82Updated this week
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆26Updated this week
• intel / intent-driven-orchestration
  Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…
  ☆36Updated last month
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆27Updated last week
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆27Updated this week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆27Updated 2 months ago
• containers / ai-lab-recipes
  Examples for building and running LLM services and applications locally with Podman
  ☆132Updated this week
• kubeflow / model-registry
  ☆105Updated this week
• sustainablecomputing / caspian
  ☆13Updated 8 months ago
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆25Updated this week
• intel / platform-aware-scheduling
  Enabling Kubernetes to make pod placement decisions with platform intelligence.
  ☆174Updated 3 weeks ago
• opendatahub-io / caikit-tgis-serving
  ☆19Updated last month
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆48Updated this week
• intel / kubernetes-power-manager
  ☆85Updated 5 months ago
• envoyproxy / ai-gateway
  Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI se…
  ☆132Updated this week
• Climatik-Project / Climatik-Project
  Carbon Limiting Auto Tuning for Kubernetes
  ☆33Updated 3 months ago
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆257Updated this week
• rh-aiservices-bu / gpu-partitioning-guide
  Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others
  ☆32Updated 4 months ago
• openshift-psap / llm-load-test
  ☆34Updated 2 weeks ago
• williamcaban / ollama-ubi
  ☆21Updated 2 months ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆46Updated 6 months ago
• kubernetes / dynamic-resource-allocation
  ☆34Updated last week
• intel / container-experience-kits
  ☆82Updated 2 months ago
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆90Updated 2 months ago
• llmnetes / llmnetes
  ☆49Updated 11 months ago
• intel / cloud-native-ai-pipeline
  AI cloud native pipeline for confidential and sustainable computing
  ☆39Updated 4 months ago
• confidential-containers / operator
  Operator to deploy confidential containers runtime
  ☆120Updated last week
• schednex-ai / schednex
  Smart Kubernetes Scheduling
  ☆73Updated this week
• cnvrg / metagpu
  K8s device plugin for GPU sharing
  ☆99Updated last year
• vultr / slik
  Slurm in Kubernetes
  ☆42Updated 2 months ago