Alternatives and similar repositories for arcadia

Users that are interested in arcadia are comparing it to the libraries listed below

• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆167Updated last month
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆267Updated this week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆276Updated 2 years ago
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆24Updated 11 months ago
• kubernetes-sigs / agent-sandbox
  agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.
  ☆135Updated last week
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆223Updated this week
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆34Updated last year
• DataTunerX / datatunerx
  Large language model fine-tuning capabilities based on cloud native and distributed computing.
  ☆92Updated last year
• seal-io / appilot
  Chat to deploy and manage applications on any infrastructure
  ☆126Updated 2 years ago
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆27Updated 10 months ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆149Updated last year
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆90Updated last month
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• llmos-ai / llmos
  An Open Source, Cloud-native AI Infrastructure Platform. Not Just GPUs.
  ☆51Updated 3 months ago
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆43Updated last year
• xflops / flame
  A distributed system for Agentic AI
  ☆31Updated last week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆71Updated 3 months ago
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated last year
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆186Updated 2 years ago
• kube-arbiter / arbiter
  An extendable scheduling and scaling tool built on Kubernetes
  ☆60Updated last year
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆128Updated last month
• kappital / kappital
  A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge
  ☆32Updated 2 years ago
• juicedata / charts
  ☆23Updated last week
• alauda / alb
  ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.
  ☆68Updated 2 months ago
• volcano-sh / descheduler
  The Volcano Descheduler
  ☆21Updated 9 months ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆52Updated 10 months ago
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆24Updated 6 months ago
• pacoxu / developers-conferences-agenda
  中国开发者活动日程（关注点：开源、开发者、云原生）
  ☆22Updated this week
• modelpack / modctl
  Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec
  ☆47Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆156Updated 2 weeks ago