Alternatives and similar repositories for GenAIInfra

Users that are interested in GenAIInfra are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆140Updated this week
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆48Updated last month
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆168Updated this week
• cncf / k8s-ai-conformance
  Kuberentes AI Conformance
  ☆147Updated this week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆714Updated this week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆30Updated last year
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆162Updated this week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆141Updated last week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆184Updated this week
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆38Updated last week
• schednex-ai / schednex
  Smart Kubernetes Scheduling
  ☆81Updated last week
• konveyor / kai
  Konveyor AI - static code analysis driven migration to new targets via Generative AI
  ☆75Updated last week
• kagent-dev / kmcp
  CLI tool and Kubernetes Controller for building, testing and deploying MCP servers
  ☆402Updated last month
• kubernetes-sigs / wg-serving
  WG Serving
  ☆34Updated last month
• kagenti / kagenti
  Kagenti Installer and User Graphical Interface
  ☆66Updated this week
• containers / ai-lab-recipes
  Examples for building and running LLM services and applications locally with Podman
  ☆188Updated 5 months ago
• opendatahub-io / caikit-tgis-serving
  ☆20Updated last week
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆95Updated 9 months ago
• agentregistry-dev / agentregistry
  Fast-track AI innovation with a centralized, trusted, curated registry
  ☆149Updated last week
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆563Updated this week
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆48Updated this week
• sustainablecomputing / caspian
  ☆15Updated last year
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆216Updated 2 weeks ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆92Updated 3 months ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆62Updated 8 months ago
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆193Updated last week
• feiskyer / kube-copilot
  Kubernetes Copilot powered by AI (OpenAI/Claude/Gemini/etc)
  ☆230Updated last month
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆41Updated this week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆649Updated last week
• kubernetes-sigs / dra-example-driver
  Example DRA driver that developers can fork and modify to get them started writing their own.
  ☆112Updated last week