Alternatives and similar repositories for ai-infra-landscape

Users that are interested in ai-infra-landscape are comparing it to the libraries listed below

• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆279Updated 2 years ago
• substratusai / runbooks
  Finetune LLMs on K8s by using Runbooks
  ☆170Updated last year
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆189Updated last week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆109Updated last year
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆198Updated this week
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 11 months ago
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆116Updated last year
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆142Updated last week
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆287Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 4 months ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆63Updated 8 months ago
• sgl-project / ome
  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…
  ☆365Updated last week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆74Updated 6 months ago
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆156Updated last year
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆472Updated this week
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆93Updated 3 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆124Updated this week
• xflops / flame
  A distributed system for Agentic AI
  ☆43Updated this week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆141Updated last week
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆186Updated 2 years ago
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆52Updated 6 months ago
• tensorchord / envd-server
  Backend server for envd
  ☆22Updated 2 years ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆96Updated this week
• coreweave / ml-containers
  ☆44Updated this week
• substratusai / vllm-docker
  ☆67Updated 10 months ago
• skai-x / elastic-jupyter-operator
  Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.
  ☆204Updated 3 years ago
• run-ai / runai-model-streamer
  ☆278Updated 2 weeks ago
• SeldonIO / trtis-k8s-scheduler
  Custom Scheduler to deploy ML models to TRTIS for GPU Sharing
  ☆11Updated 5 years ago
• llm-d / llm-d-kv-cache
  Distributed KV cache scheduling & offloading libraries
  ☆98Updated last week
• NVIDIA / cloud-native-docs
  Documentation repository for NVIDIA Cloud Native Technologies
  ☆35Updated last week