makllama / makllama
MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
☆27Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for makllama
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆29Updated this week
- 🎉 An awesome & curated list of best LLMOps tools.☆29Updated last month
- ☆24Updated last month
- A diverse, simple, and secure all-in-one LLMOps platform☆86Updated 2 months ago
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆9Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆54Updated 2 weeks ago
- Dragonfly Helm Charts☆32Updated 2 weeks ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- IOMesh Helm Charts Repo☆14Updated last week
- A stress testing tool for the scheduler in a large-scale scenario.☆14Updated 6 months ago
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.☆54Updated 2 years ago
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆60Updated last week
- ☆214Updated this week
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆18Updated 2 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆130Updated last month
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge☆33Updated last year
- Your AI Kubernetes Expert☆174Updated last year
- Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆113Updated last week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆141Updated this week
- ☆57Updated 2 months ago
- Manage kubernetes node-level kernel tuning ( using sysctl ).☆26Updated last year
- One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or ev…☆239Updated last year
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆58Updated this week
- NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes☆114Updated 3 weeks ago
- The official Kubernetes operator for etcd.☆36Updated 3 weeks ago
- A distributed system for intelligent workload☆19Updated 6 months ago
- ☆64Updated this week
- InfiniBand SR-IOV CNI☆10Updated last week
- The storage system of sealos, aims to be a high-performance, high-reliability, and auto-scaling distributed file system☆143Updated last year
- Backend server for envd☆21Updated 11 months ago