Alternatives and similar repositories for arcadia:

Users that are interested in arcadia are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆49Updated this week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆35Updated last month
• seal-io / appilot
  Chat to deploy and manage applications on any infrastructure
  ☆126Updated last year
• DataTunerX / datatunerx
  Large language model fine-tuning capabilities based on cloud native and distributed computing.
  ☆91Updated 10 months ago
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆59Updated 2 weeks ago
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆19Updated last month
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆168Updated this week
• nekomeowww / ollama-operator
  Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆123Updated this week
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆33Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆60Updated 9 months ago
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆58Updated 2 weeks ago
• elastic-ai / elastic-gpu
  Using CRDs to manage GPU resources in Kubernetes.
  ☆193Updated 2 years ago
• run-ai / fake-gpu-operator
  ☆86Updated this week
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 2 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆247Updated last year
• envoyproxy / ai-gateway
  Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI se…
  ☆89Updated this week
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆25Updated 3 weeks ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆74Updated 8 months ago
• douban / charts
  Helm charts from douban
  ☆48Updated 2 months ago
• kubevela / workflow
  Declarative Workflow of KubeVela which can run as standalone.
  ☆115Updated last month
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆113Updated 4 months ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆47Updated 2 weeks ago
• alauda / kubeflow-chart
  Kubeflow helm chart
  ☆142Updated last year
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆259Updated this week
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆50Updated 4 months ago
• kube-arbiter / arbiter
  An extendable scheduling and scaling tool built on Kubernetes
  ☆58Updated last year
• kappital / kappital
  A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge
  ☆33Updated last year
• knight42 / kopilot
  Your AI Kubernetes Expert
  ☆175Updated last year
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆36Updated 3 months ago
• skai-x / elastic-jupyter-operator
  Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.
  ☆195Updated 2 years ago