Alternatives and similar repositories for arcadia:

Users that are interested in arcadia are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆123Updated this week
• qingwave / kubewizard
  ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.
  ☆18Updated 3 months ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆83Updated last week
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆33Updated last year
• DataTunerX / datatunerx
  Large language model fine-tuning capabilities based on cloud native and distributed computing.
  ☆92Updated last year
• seal-io / appilot
  Chat to deploy and manage applications on any infrastructure
  ☆126Updated last year
• flame-sh / flame
  A distributed engine for intelligent workload
  ☆27Updated 2 months ago
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆20Updated 4 months ago
• Project-HAMi / HAMi-WebUI
  ☆36Updated 2 weeks ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• higress-group / higress-standalone
  ☆66Updated this week
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆141Updated 6 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆53Updated 7 months ago
• antgroup / aievo
  AIEvo is a multi-agent framework open sourced by Ant Group. Through this framework, you can create a multi-agent application.
  ☆71Updated 3 weeks ago
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 5 months ago
• elastic-ai / elastic-gpu
  Using CRDs to manage GPU resources in Kubernetes.
  ☆197Updated 2 years ago
• kube-arbiter / arbiter
  An extendable scheduling and scaling tool built on Kubernetes
  ☆58Updated last year
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆71Updated last month
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆16Updated 4 months ago
• kappital / kappital
  A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge
  ☆33Updated last year
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆80Updated 11 months ago
• kubevela / kubevela-core-api
  Core API package for KubeVela https://github.com/kubevela/kubevela
  ☆24Updated last month
• kubeagi / agent-portal
  Portal to let user explore, create, manage AI Agents/GPTs
  ☆9Updated last year
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆64Updated 3 weeks ago
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆184Updated this week
• kubevela / workflow
  Declarative Workflow of KubeVela which can run as standalone.
  ☆120Updated last month
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆397Updated this week
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆51Updated 3 months ago
• k-cloud-labs / scheduler-stress-test
  A stress testing tool for the scheduler in a large-scale scenario.
  ☆16Updated 11 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆263Updated last year