kubeagi / arcadiaLinks
A diverse, simple, and secure all-in-one LLMOps platform
☆108Updated 11 months ago
Alternatives and similar repositories for arcadia
Users that are interested in arcadia are comparing it to the libraries listed below
Sorting:
- 🎉 An awesome & curated list of best LLMOps tools.☆154Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆252Updated this week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆273Updated last year
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 9 months ago
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆213Updated last week
- Large language model fine-tuning capabilities based on cloud native and distributed computing.☆91Updated last year
- ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.☆25Updated 8 months ago
- A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts☆34Updated last year
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆149Updated 10 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆71Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆69Updated last month
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.☆89Updated this week
- An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.☆47Updated last month
- Your AI Kubernetes Expert☆185Updated 2 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆23Updated 4 months ago
- Declarative Workflow of KubeVela which can run as standalone.☆122Updated last month
- The Volcano Descheduler☆17Updated 7 months ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆572Updated this week
- Knowledge for GPTScript☆29Updated 10 months ago
- A distributed engine for elastic workload, e.g. AI Agent, Quant☆28Updated this week
- MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.☆42Updated last year
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆65Updated 2 weeks ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆86Updated last year
- Device-plugin for volcano vgpu which support hard resource isolation☆103Updated 2 months ago
- A federation scheduler for multi-cluster☆52Updated 2 months ago
- An extendable scheduling and scaling tool built on Kubernetes☆60Updated last year
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated this week
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆38Updated this week
- Device plugins for Volcano, e.g. GPU☆128Updated 5 months ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago