kubeagi / arcadia
A diverse, simple, and secure all-in-one LLMOps platform
โ102Updated 7 months ago
Alternatives and similar repositories for arcadia:
Users that are interested in arcadia are comparing it to the libraries listed below
- โธ๏ธ Easy, advanced inference platform for large language models on Kubernetes. ๐ Star to support our work!โ163Updated this week
- ๐ An awesome & curated list of best LLMOps tools.โ97Updated this week
- Chat to deploy and manage applications on any infrastructureโ126Updated last year
- โจKubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.โ20Updated 3 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.โ65Updated last year
- Large language model fine-tuning capabilities based on cloud native and distributed computing.โ92Updated last year
- A distributed engine for intelligent workloadโ27Updated 3 months ago
- A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifactsโ33Updated last year
- ๐ซ A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIโฆโ22Updated 5 months ago
- The Volcano Deschedulerโ14Updated 3 months ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)โ265Updated last year
- Device-plugin for volcano vgpu which support hard resource isolationโ73Updated last week
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistantโ54Updated 8 months ago
- MCP Server for kubernetes management and diagnose your cluster and applicationsโ13Updated last week
- ๐งฏ Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.โ29Updated 4 months ago
- The API (CRD) of Volcanoโ39Updated 2 weeks ago
- Knowledge for GPTScriptโ29Updated 6 months ago
- Portal to let user explore, create, manage AI Agents/GPTsโ9Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.โ66Updated this week
- โ37Updated last month
- ๅๅฎขโ20Updated 3 months ago
- Using CRDs to manage GPU resources in Kubernetes.โ199Updated 2 years ago
- Device plugins for Volcano, e.g. GPUโ119Updated last month
- AIEvo is a multi-agent framework open sourced by Ant Group. Through this framework, you can create a multi-agent application.โ75Updated last week
- This is a landscape of the infrastructure that powers the generative AI ecosystemโ144Updated 6 months ago
- An extendable scheduling and scaling tool built on Kubernetesโ59Updated last year
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replicationโ421Updated last week
- Open-source observability for your LLM application.โ51Updated 4 months ago
- Helm charts for the KubeRay projectโ43Updated last month
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edgeโ33Updated last year