kubeagi / arcadiaLinks
A diverse, simple, and secure all-in-one LLMOps platform
โ107Updated 11 months ago
Alternatives and similar repositories for arcadia
Users that are interested in arcadia are comparing it to the libraries listed below
Sorting:
- ๐ An awesome & curated list of best LLMOps tools.โ147Updated 2 weeks ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)โ270Updated last year
- โธ๏ธ Easy, advanced inference platform for large language models on Kubernetes. ๐ Star to support our work!โ239Updated last week
- A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifactsโ34Updated last year
- ๐ข Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! ๐ซโ205Updated last week
- This is a landscape of the infrastructure that powers the generative AI ecosystemโ148Updated 10 months ago
- ๐ซ A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIโฆโ24Updated 8 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.โ70Updated last year
- Knowledge for GPTScriptโ29Updated 9 months ago
- Large language model fine-tuning capabilities based on cloud native and distributed computing.โ91Updated last year
- Chat to deploy and manage applications on any infrastructureโ126Updated last year
- โจKubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.โ25Updated 7 months ago
- Your AI Kubernetes Expertโ183Updated 2 years ago
- MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.โ42Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.โ69Updated last month
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistantโ56Updated 11 months ago
- Device-plugin for volcano vgpu which support hard resource isolationโ101Updated last month
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployโฆโ86Updated last year
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.โ88Updated last week
- Declarative Workflow of KubeVela which can run as standalone.โ122Updated last month
- The Volcano Deschedulerโ17Updated 7 months ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.โ201Updated 3 years ago
- ๐งฏ Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.โ31Updated last week
- A distributed engine for elastic workload, e.g. AI Agent, Quantโ29Updated this week
- โ48Updated last month
- ๐ชถ Lightweight OpenAI drop-in replacement for Kubernetesโ146Updated last year
- an MLOps/LLMOps platformโ231Updated 8 months ago
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.โ64Updated last month
- Device plugins for Volcano, e.g. GPUโ128Updated 5 months ago
- ๅๅฎขโ24Updated 3 months ago