Alternatives and similar repositories for GenAIInfra

Users that are interested in GenAIInfra are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆146Updated this week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆175Updated last week
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆48Updated last month
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆161Updated this week
• cncf / k8s-ai-conformance
  Kubernetes AI Conformance
  ☆157Updated last week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆142Updated last week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆190Updated this week
• kubernetes-sigs / wg-serving
  WG Serving
  ☆34Updated last month
• containers / ai-lab-recipes
  Examples for building and running LLM services and applications locally with Podman
  ☆190Updated 6 months ago
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆95Updated 9 months ago
• konveyor / kai
  Konveyor AI - static code analysis driven migration to new targets via Generative AI
  ☆76Updated last week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆30Updated last year
• opendatahub-io / caikit-tgis-serving
  ☆20Updated last week
• kagent-dev / kmcp
  CLI tool and Kubernetes Controller for building, testing and deploying MCP servers
  ☆417Updated this week
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆576Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆221Updated this week
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆50Updated this week
• schednex-ai / schednex
  Smart Kubernetes Scheduling
  ☆82Updated this week
• agentregistry-dev / agentregistry
  Fast-track AI innovation with a centralized, trusted, curated registry
  ☆166Updated last week
• feiskyer / kube-copilot
  Kubernetes Copilot powered by AI (OpenAI/Claude/Gemini/etc)
  ☆230Updated 2 months ago
• openshift-psap / llm-load-test
  ☆51Updated 6 months ago
• opendatahub-io / distributed-workloads
  Artifacts for the Distributed Workloads stack as part of ODH
  ☆33Updated last week
• NVIDIA / nvkind
  ☆191Updated 2 weeks ago
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆287Updated 2 weeks ago
• treebeardtech / kubeflow-bootstrap
  🪐 1-click Kubeflow using ArgoCD
  ☆72Updated last year
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆656Updated last week
• kubernetes-sigs / dra-example-driver
  Example DRA driver that developers can fork and modify to get them started writing their own.
  ☆117Updated this week
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆223Updated 2 weeks ago
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆304Updated this week
• llm-d / llm-d-model-service
  Simplified model deployment on llm-d
  ☆28Updated 7 months ago