kubeagi / arcadiaLinks
A diverse, simple, and secure all-in-one LLMOps platform
β108Updated last year
Alternatives and similar repositories for arcadia
Users that are interested in arcadia are comparing it to the libraries listed below
Sorting:
- π An awesome & curated list of best LLMOps tools.β161Updated last week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)β275Updated last year
- βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!β261Updated 3 weeks ago
- π’ Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! π«β217Updated last week
- Chat to deploy and manage applications on any infrastructureβ126Updated last year
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β24Updated 10 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystemβ149Updated 11 months ago
- β¨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.β26Updated 8 months ago
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.β91Updated last week
- MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.β42Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.β72Updated last year
- Your AI Kubernetes Expertβ186Updated 2 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.β70Updated 2 months ago
- Large language model fine-tuning capabilities based on cloud native and distributed computing.β93Updated last year
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.β89Updated this week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprisesβ24Updated 5 months ago
- Knowledge for GPTScriptβ29Updated 11 months ago
- The Volcano Deschedulerβ18Updated 8 months ago
- A distributed engine for elastic workload, e.g. AI Agent, Quantβ29Updated last week
- Declarative Workflow of KubeVela which can run as standalone.β122Updated 2 months ago
- A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifactsβ34Updated last year
- An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.β49Updated last month
- Open Weight, tool-calling LLMsβ156Updated 11 months ago
- Lightweight service mesh for Kubernetes East-West and North-South traffic management, uses ebpf for layer4 and pipy proxy for layer7 traβ¦β66Updated last week
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.β65Updated last month
- δΈε½εΌεθ ζ΄»ε¨ζ₯η¨οΌε ³ζ³¨ηΉοΌεΌζΊγεΌεθ γδΊεηοΌβ21Updated last week
- The Kubernetes Operator of Milvus.β95Updated last week
- β22Updated last week
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistantβ56Updated last year
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β33Updated last week