makllama / makllamaLinks
MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
☆42Updated last year
Alternatives and similar repositories for makllama
Users that are interested in makllama are comparing it to the libraries listed below
Sorting:
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆205Updated last week
- 🎉 An awesome & curated list of best LLMOps tools.☆147Updated 2 weeks ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆239Updated last week
- A diverse, simple, and secure all-in-one LLMOps platform☆107Updated 11 months ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆50Updated 5 months ago
- ☆139Updated last month
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆34Updated last week
- Your AI Kubernetes Expert☆184Updated 2 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆69Updated last month
- MCP server connecting to Kubernetes☆340Updated 3 weeks ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆124Updated this week
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆413Updated this week
- NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes☆140Updated this week
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.☆88Updated last week
- Run native macOS workloads on Kubernetes☆308Updated 3 months ago
- ☆238Updated this week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆270Updated last year
- A toolkit for discovering cluster network topology.☆63Updated this week
- ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.☆25Updated 7 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆148Updated 10 months ago
- The Volcano Descheduler☆17Updated 7 months ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆546Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆31Updated last week
- Device plugins for Volcano, e.g. GPU☆128Updated 5 months ago
- ☆163Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆251Updated 2 weeks ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆20Updated 4 months ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆143Updated 2 years ago
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago