Alternatives and similar repositories for makllama

Users that are interested in makllama are comparing it to the libraries listed below

• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆108Updated last year
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆261Updated 3 weeks ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆161Updated last week
• kubernetes-sigs / agent-sandbox
  agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.
  ☆89Updated this week
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆217Updated last week
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆24Updated 5 months ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆129Updated this week
• modelpack / modctl
  Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec
  ☆42Updated last week
• NVIDIA / vgpu-device-manager
  NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes
  ☆142Updated this week
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆91Updated last week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆70Updated 2 months ago
• run-ai / fake-gpu-operator
  ☆147Updated 2 weeks ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆149Updated 11 months ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆70Updated last week
• strowk / mcp-k8s-go
  MCP server connecting to Kubernetes
  ☆347Updated 2 weeks ago
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 11 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆436Updated last week
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆26Updated 8 months ago
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆72Updated this week
• NVIDIA / nvkind
  ☆170Updated 3 weeks ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆33Updated last week
• agoda-com / macOS-vz-kubelet
  Run native macOS workloads on Kubernetes
  ☆314Updated 4 months ago
• NVIDIA / k8s-driver-manager
  The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.
  ☆37Updated last week
• run-ai / runai-model-streamer
  ☆255Updated this week
• xflops / flame
  A distributed engine for elastic workload, e.g. AI Agent, Quant
  ☆29Updated last week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆275Updated last year
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆95Updated this week
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆186Updated 2 years ago
• SlinkyProject / slurm-operator
  Run Slurm on Kubernetes. A Slinky project.
  ☆172Updated this week
• kubernetes / dynamic-resource-allocation
  ☆39Updated this week