Alternatives and similar repositories for ai-infra-statistics:

Users that are interested in ai-infra-statistics are comparing it to the libraries listed below

• tensorchord / envd-server
  Backend server for envd
  ☆20Updated last year
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated 2 years ago
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆29Updated last month
• PaddleFlow / ElasticServing
  Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.
  ☆11Updated 3 years ago
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆32Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• dyweb / cloudab
  Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台
  ☆36Updated 3 years ago
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆17Updated 11 months ago
• flame-sh / flame
  A distributed engine for intelligent workload
  ☆27Updated 2 months ago
• gaocegege / k8s-example-operator
  Feasibility research for using kind to support e2e tests for kubebuilder(v2)-generated Kubernetes operators.
  ☆13Updated 5 years ago
• kemingy / gathers
  clustering algorithm implementation
  ☆13Updated last week
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• openeuler-mirror / KubeOS
  ☆17Updated last month
• Kong / mcp-konnect
  A Model Context Protocol (MCP) server for interacting with Kong Konnect APIs, allowing AI assistants to query and analyze Kong Gateway co…
  ☆26Updated last month
• topling / topling-ark
  Topling core libraries in an ark
  ☆14Updated 6 months ago
• Alluxio / alluxio-csi
  ☆23Updated 2 years ago
• gpucloud / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆15Updated 5 years ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆38Updated 3 months ago
• zhihu / chaika
  Elastic cache solution on Kubernetes
  ☆11Updated 4 years ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆29Updated 4 months ago
• danyangz / lightning
  Lightning In-Memory Object Store
  ☆45Updated 3 years ago
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆16Updated 7 months ago
• xline-kv / xline-operator
  The xline-operator is a powerful tool designed to automate the process of bootstrapping, monitoring, snapshotting, and recovering an xlin…
  ☆16Updated last year
• intel / nodus
  Simulated large clusters for Kubernetes scheduler validation.
  ☆15Updated 2 years ago
• iomesh / docs
  ☆9Updated last year
• houminz / paper-reading
  Paper Reading：涉及分布式、虚拟化、网络、机器学习
  ☆23Updated 4 years ago
• cloudwego / runtimex
  Runtimex package help to expose Go Runtime internals representation safely.
  ☆13Updated 2 months ago