Alternatives and similar repositories for GenAIInfra

Users that are interested in GenAIInfra are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆140Updated this week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆704Updated this week
• cncf / k8s-ai-conformance
  ☆116Updated 3 weeks ago
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆47Updated 2 weeks ago
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆95Updated 7 months ago
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆38Updated last month
• schednex-ai / schednex
  Smart Kubernetes Scheduling
  ☆81Updated this week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆30Updated last year
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆154Updated last week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆147Updated this week
• konveyor / kai
  Konveyor AI - static code analysis driven migration to new targets via Generative AI
  ☆74Updated this week
• containers / ai-lab-recipes
  Examples for building and running LLM services and applications locally with Podman
  ☆184Updated 4 months ago
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆187Updated last week
• agentregistry-dev / agentregistry
  Fast-track AI innovation with a centralized, trusted, curated registry
  ☆132Updated this week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆172Updated last week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆134Updated this week
• llmnetes / llmnetes
  ☆62Updated last year
• kubernetes / dynamic-resource-allocation
  ☆39Updated this week
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆48Updated last week
• kagent-dev / kmcp
  CLI tool and Kubernetes Controller for building, testing and deploying MCP servers
  ☆383Updated last week
• cncf / sandbox
  Applications for Sandbox go here! ⏳📦🧪
  ☆171Updated this week
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆29Updated last month
• intel / intel-resource-drivers-for-kubernetes
  ☆33Updated 3 weeks ago
• feiskyer / kube-copilot
  Kubernetes Copilot powered by AI (OpenAI/Claude/Gemini/etc)
  ☆225Updated 2 weeks ago
• kubernetes-sigs / wg-serving
  WG Serving
  ☆31Updated last month
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆537Updated this week
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆286Updated this week
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆84Updated last week
• modelpack / modctl
  Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec
  ☆50Updated last week
• Climatik-Project / Climatik-Project
  Carbon Limiting Auto Tuning for Kubernetes
  ☆37Updated last year