Alternatives and similar repositories for Awesome-LLMOps

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆284Updated last month
• kubernetes-sigs / agent-sandbox
  agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.
  ☆667Updated last week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆109Updated last year
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆163Updated this week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆140Updated this week
• sgl-project / ome
  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…
  ☆355Updated this week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆649Updated last week
• kubernetes-sigs / wg-serving
  WG Serving
  ☆34Updated last month
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆25Updated last year
• sgl-project / rbg
  A workload for deploying LLM inference services on Kubernetes
  ☆153Updated this week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆141Updated last week
• alexei-led / k8s-mcp-server
  K8s-mcp-server is a Model Context Protocol (MCP) server that enables AI assistants like Claude to securely execute Kubernetes commands. I…
  ☆178Updated 8 months ago
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆30Updated last year
• strowk / mcp-k8s-go
  MCP server connecting to Kubernetes
  ☆368Updated 3 weeks ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆92Updated 3 months ago
• wenhuwang / mcp-k8s-eye
  MCP Server for kubernetes management and diagnose your cluster and applications
  ☆26Updated 7 months ago
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆117Updated this week
• ai-dynamo / grove
  Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
  ☆138Updated last week
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆73Updated last week
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆48Updated last month
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆168Updated this week
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆563Updated this week
• modelpack / modctl
  Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec
  ☆59Updated last week
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆140Updated 2 weeks ago
• BaizeAI / dataset
  Simplified Data Management and Sharing for Kubernetes
  ☆17Updated 3 weeks ago
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆229Updated last week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆73Updated 5 months ago
• llm-d / llm-d-kv-cache
  Distributed KV cache scheduling & offloading libraries
  ☆94Updated this week
• openkruise / agents
  Rapid and cost-effective operator and best practice for agent sandbox lifecycle management.
  ☆69Updated this week
• run-ai / fake-gpu-operator
  ☆192Updated this week