Alternatives and similar repositories for GenAIInfra

Users that are interested in GenAIInfra are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆130Updated last week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆688Updated last week
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆30Updated 11 months ago
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆37Updated this week
• containers / ai-lab-recipes
  Examples for building and running LLM services and applications locally with Podman
  ☆180Updated 2 months ago
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆149Updated this week
• opendatahub-io / caikit-tgis-serving
  ☆19Updated last week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆107Updated last week
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆45Updated 3 weeks ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆106Updated last week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆165Updated 2 weeks ago
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆180Updated this week
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆59Updated 5 months ago
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆30Updated this week
• caikit / caikit
  Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.
  ☆107Updated this week
• konveyor / kai
  Konveyor AI - static code analysis driven migration to new targets via Generative AI
  ☆72Updated this week
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆501Updated this week
• cncf / tag-runtime
  🏃🏿‍♀️🏃🏽‍♀️🏃🏻‍♂️🕒CNCF Technical Advisory Group for Runtime
  ☆94Updated 6 months ago
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆44Updated 2 months ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆74Updated this week
• openshift / instaslice-operator
  InstaSlice Operator facilitates slicing of accelerators using stable APIs
  ☆46Updated this week
• kagenti / kagenti
  Kagenti Installer and User Graphical Interface
  ☆36Updated this week
• sustainablecomputing / caspian
  ☆15Updated last year
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆28Updated 2 weeks ago
• opendatahub-io / distributed-workloads
  Artifacts for the Distributed Workloads stack as part of ODH
  ☆33Updated last week
• schednex-ai / schednex
  Smart Kubernetes Scheduling
  ☆81Updated this week
• llmnetes / llmnetes
  ☆60Updated last year
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆202Updated 2 weeks ago
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆196Updated this week
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆268Updated last week