Alternatives and similar repositories for arcadia

Users that are interested in arcadia are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆278Updated last week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆176Updated 3 weeks ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆278Updated 2 years ago
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆226Updated this week
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆25Updated last year
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆29Updated 11 months ago
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated last year
• DataTunerX / datatunerx
  Large language model fine-tuning capabilities based on cloud native and distributed computing.
  ☆92Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆151Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• seal-io / appilot
  Chat to deploy and manage applications on any infrastructure
  ☆126Updated 2 years ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆91Updated 2 months ago
• volcano-sh / descheduler
  The Volcano Descheduler
  ☆21Updated 11 months ago
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆186Updated 2 years ago
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆34Updated last year
• kubernetes-sigs / agent-sandbox
  agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.
  ☆506Updated last week
• llmos-ai / llmos
  An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.
  ☆54Updated 4 months ago
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆639Updated this week
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆24Updated 8 months ago
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆133Updated last week
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆95Updated this week
• BaizeAI / dataset
  Simplified Data Management and Sharing for Kubernetes
  ☆14Updated last week
• volcano-sh / volcano-global
  A federation scheduler for multi-cluster
  ☆59Updated last month
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆43Updated last year
• chenhunghan / ialacol
  🪶 Lightweight OpenAI drop-in replacement for Kubernetes
  ☆146Updated last year
• kubevela / workflow
  Declarative Workflow of KubeVela which can run as standalone.
  ☆125Updated last month
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆33Updated last year
• alauda / alb
  ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.
  ☆68Updated 3 months ago
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆129Updated 9 months ago
• xflops / flame
  A distributed system for Agentic AI
  ☆34Updated this week