kubeagi / arcadia
A diverse, simple, and secure all-in-one LLMOps platform
☆101Updated 6 months ago
Alternatives and similar repositories for arcadia:
Users that are interested in arcadia are comparing it to the libraries listed below
- 🎉 An awesome & curated list of best LLMOps tools.☆63Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆105Updated this week
- Large language model fine-tuning capabilities based on cloud native and distributed computing.☆92Updated last year
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆20Updated 3 months ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆28Updated 3 months ago
- A distributed engine for intelligent workload☆27Updated last month
- Chat to deploy and manage applications on any infrastructure☆126Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆65Updated 11 months ago
- ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.☆16Updated 2 months ago
- A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts☆33Updated last year
- The API (CRD) of Volcano☆37Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆339Updated this week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆64Updated last week
- Device-plugin for volcano vgpu which support hard resource isolation☆67Updated last week
- A federation scheduler for multi-cluster☆33Updated last month
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆290Updated this week
- Automated pull requests reviewing and issues triaging with ChatGPT.☆70Updated last year
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆124Updated 3 years ago
- Using CRDs to manage GPU resources in Kubernetes.☆197Updated 2 years ago
- The Volcano Descheduler☆13Updated 2 months ago
- Portal to let user explore, create, manage AI Agents/GPTs☆9Updated 11 months ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆53Updated 6 months ago
- Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI se…☆181Updated this week
- Device plugins for Volcano, e.g. GPU☆117Updated this week
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆175Updated this week
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆79Updated 10 months ago
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge☆33Updated last year
- Open-source observability for your LLM application.☆51Updated 2 months ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆195Updated 3 years ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆140Updated 2 years ago