Alternatives and similar repositories for GenAIInfra

Users that are interested in GenAIInfra are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆140Updated last week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆713Updated this week
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆38Updated last week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆157Updated last week
• containers / ai-lab-recipes
  Examples for building and running LLM services and applications locally with Podman
  ☆188Updated 4 months ago
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆157Updated last week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆30Updated last year
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆95Updated 8 months ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆137Updated this week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆176Updated last month
• kagenti / kagenti
  Kagenti Installer and User Graphical Interface
  ☆61Updated this week
• opendatahub-io / caikit-tgis-serving
  ☆20Updated last week
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆48Updated this week
• caikit / caikit
  Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.
  ☆111Updated 2 months ago
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆48Updated 2 weeks ago
• schednex-ai / schednex
  Smart Kubernetes Scheduling
  ☆81Updated this week
• konveyor / kai
  Konveyor AI - static code analysis driven migration to new targets via Generative AI
  ☆74Updated 2 weeks ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆88Updated 2 weeks ago
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆550Updated this week
• openshift-psap / llm-load-test
  ☆51Updated 4 months ago
• kagent-dev / kmcp
  CLI tool and Kubernetes Controller for building, testing and deploying MCP servers
  ☆395Updated 2 weeks ago
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆215Updated last week
• cncf / k8s-ai-conformance
  ☆130Updated last week
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆29Updated 2 months ago
• llmnetes / llmnetes
  ☆62Updated last year
• kubernetes-sigs / wg-serving
  WG Serving
  ☆32Updated last week
• opendatahub-io / distributed-workloads
  Artifacts for the Distributed Workloads stack as part of ODH
  ☆33Updated this week
• Climatik-Project / Climatik-Project
  Carbon Limiting Auto Tuning for Kubernetes
  ☆37Updated last year
• agentregistry-dev / agentregistry
  Fast-track AI innovation with a centralized, trusted, curated registry
  ☆140Updated this week
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆190Updated this week