Alternatives and similar repositories for makllama:

Users that are interested in makllama are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆53Updated this week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆37Updated this week
• NVIDIA / vgpu-device-manager
  NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes
  ☆124Updated this week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆93Updated 4 months ago
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆60Updated last week
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆175Updated last year
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆177Updated this week
• nekomeowww / ollama-operator
  Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆129Updated last week
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆32Updated this week
• NVIDIA / gpu-driver-container
  The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.
  ☆85Updated this week
• run-ai / fake-gpu-operator
  ☆88Updated 2 weeks ago
• dragonflyoss / helm-charts
  Dragonfly Helm Charts
  ☆33Updated this week
• DaoCloud / ckube
  Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…
  ☆19Updated 2 years ago
• flame-sh / flame
  A distributed system for intelligent workload
  ☆19Updated 2 weeks ago
• cnvrg / metagpu
  K8s device plugin for GPU sharing
  ☆99Updated last year
• kubernetes-sigs / dra-example-driver
  Example DRA driver that developers can fork and modify to get them started writing their own.
  ☆57Updated last week
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆175Updated this week
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆135Updated 3 months ago
• data-accelerator / dadi-p2proxy
  HTTP based Tree-shaped Peer2Peer blob transfer proxy, distributing images or blob data.
  ☆20Updated 2 years ago
• copilot-io / runtime-copilot
  The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…
  ☆12Updated last year
• elastic-ai / elastic-gpu-scheduler
  elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.
  ☆137Updated 2 years ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆25Updated last month
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆270Updated this week
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆113Updated 4 months ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆80Updated this week
• stackhpc / slurm-k8s-cluster
  A Slurm cluster for Kubernetes
  ☆50Updated 6 months ago
• Mellanox / nvidia-k8s-ipam
  IPAM plugin for kubernetes
  ☆15Updated this week
• yeahdongcn / kustohelmize
  Tired of creating Helm Charts from scratch? Try Kustohelmize today!
  ☆17Updated last week
• kubevela / kube-trigger
  kube-trigger watches events and triggers actions in a programmable way.
  ☆50Updated last year
• kubernetes / dynamic-resource-allocation
  ☆32Updated this week