Alternatives and similar repositories for arcadia

Users that are interested in arcadia are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆287Updated 2 weeks ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆190Updated last week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆280Updated 2 years ago
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆229Updated this week
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆30Updated last year
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆25Updated last year
• seal-io / appilot
  Chat to deploy and manage applications on any infrastructure
  ☆126Updated 2 years ago
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆208Updated this week
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆152Updated last year
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆93Updated 4 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• DataTunerX / datatunerx
  Large language model fine-tuning capabilities based on cloud native and distributed computing.
  ☆92Updated last year
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated last year
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆186Updated 2 years ago
• kubernetes-sigs / wg-serving
  WG Serving
  ☆34Updated last month
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆53Updated last year
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆35Updated 2 years ago
• xflops / flame
  A distributed system for Agentic AI
  ☆44Updated this week
• fuzzylabs / sre-agent
  A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.
  ☆145Updated this week
• volcano-sh / descheduler
  The Volcano Descheduler
  ☆21Updated last year
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆236Updated last year
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆44Updated last year
• inference-gateway / inference-gateway
  An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud p…
  ☆98Updated this week
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆143Updated last month
• llmos-ai / llmos
  An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.
  ☆55Updated 6 months ago
• kube-arbiter / arbiter
  An extendable scheduling and scaling tool built on Kubernetes
  ☆60Updated 2 years ago
• zenmodel / zenmodel
  ZenModel is a framework for building LLM applications with agentic workflow
  ☆74Updated last year
• kubevela / workflow
  Declarative Workflow of KubeVela which can run as standalone.
  ☆124Updated 2 months ago
• pacoxu / developers-conferences-agenda
  中国开发者活动日程（关注点：开源、开发者、云原生）
  ☆23Updated last week
• copilot-io / runtime-copilot
  The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…
  ☆12Updated 2 years ago