Alternatives and similar repositories for arcadia

Users that are interested in arcadia are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆286Updated last week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆184Updated last week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆279Updated 2 years ago
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆25Updated last year
• DataTunerX / datatunerx
  Large language model fine-tuning capabilities based on cloud native and distributed computing.
  ☆92Updated last year
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆30Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆152Updated last year
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆229Updated last week
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆168Updated this week
• BaizeAI / dataset
  Simplified Data Management and Sharing for Kubernetes
  ☆17Updated this week
• volcano-sh / descheduler
  The Volcano Descheduler
  ☆21Updated 11 months ago
• xflops / flame
  A distributed system for Agentic AI
  ☆42Updated this week
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆142Updated 3 weeks ago
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆26Updated 8 months ago
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆43Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• seal-io / appilot
  Chat to deploy and manage applications on any infrastructure
  ☆126Updated 2 years ago
• alauda / alb
  ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.
  ☆68Updated 4 months ago
• pacoxu / developers-conferences-agenda
  中国开发者活动日程（关注点：开源、开发者、云原生）
  ☆23Updated last week
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆35Updated 2 years ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆53Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆57Updated last year
• openkruise / agents
  Rapid and cost-effective operator and best practice for agent sandbox lifecycle management.
  ☆80Updated this week
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆186Updated 2 years ago
• kubevela / workflow
  Declarative Workflow of KubeVela which can run as standalone.
  ☆124Updated last month
• kubernetes-sigs / wg-serving
  WG Serving
  ☆34Updated last month
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated last year
• llmos-ai / llmos
  An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.
  ☆54Updated 5 months ago
• flomesh-io / fsm
  Lightweight service mesh for Kubernetes East-West and North-South traffic management, uses eBPF for layer4 and pipy proxy for layer7 tra…
  ☆68Updated this week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆74Updated 6 months ago