Alternatives and similar repositories for makllama

Users that are interested in makllama are comparing it to the libraries listed below

• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆167Updated last month
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆267Updated this week
• kubernetes-sigs / agent-sandbox
  agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.
  ☆135Updated last week
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆223Updated this week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆109Updated last year
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆134Updated this week
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆85Updated this week
• modelpack / modctl
  Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec
  ☆47Updated this week
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆24Updated 11 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆450Updated this week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆71Updated 3 months ago
• chaunceyjiang / fake-gpu
  This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.
  ☆56Updated 8 months ago
• strowk / mcp-k8s-go
  MCP server connecting to Kubernetes
  ☆355Updated this week
• agoda-com / macOS-vz-kubelet
  Run native macOS workloads on Kubernetes
  ☆328Updated last month
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆24Updated 6 months ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆90Updated last month
• run-ai / fake-gpu-operator
  ☆159Updated 3 weeks ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆149Updated last year
• NVIDIA / vgpu-device-manager
  NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes
  ☆148Updated this week
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆27Updated 10 months ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆81Updated this week
• NVIDIA / nvkind
  ☆179Updated this week
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆103Updated this week
• llmos-ai / llmos
  An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.
  ☆51Updated 3 months ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆33Updated last week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆276Updated 2 years ago
• pacoxu / developers-conferences-agenda
  中国开发者活动日程（关注点：开源、开发者、云原生）
  ☆22Updated this week
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆46Updated last month
• ai-dynamo / grove
  Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
  ☆86Updated last week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆611Updated this week