Alternatives and similar repositories for ai-infra-statistics

Users that are interested in ai-infra-statistics are comparing it to the libraries listed below

• tensorchord / envd-server
  Backend server for envd
  ☆21Updated last year
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆29Updated 6 months ago
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆16Updated 2 years ago
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• topling / topling-ark
  Topling core libraries in an ark
  ☆16Updated 3 weeks ago
• kemingy / gathers
  clustering algorithm implementation
  ☆13Updated 2 months ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• Albus-Tan / SJTU-SE3357-OS-notes
  SJTU SE3357 操作系统笔记 OS Notes
  ☆17Updated 2 years ago
• dyweb / cloudab
  Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台
  ☆36Updated 4 years ago
• PaddleFlow / ElasticServing
  Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.
  ☆10Updated 3 years ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 3 years ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 4 years ago
• vescale / zgraph
  An embeddable graph database for large-scale vertices and edges
  ☆74Updated 2 years ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆23Updated 3 years ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆275Updated last year
• pacoxu / developers-conferences-agenda
  中国开发者活动日程（关注点：开源、开发者、云原生）
  ☆21Updated this week
• houminz / paper-reading
  Paper Reading：涉及分布式、虚拟化、网络、机器学习
  ☆23Updated 5 years ago
• simon-mo / vLLM-Benchmark
  ☆31Updated 5 months ago
• NVIDIA / go-nvlib
  A collection of useful Go libraries for use with NVIDIA GPU management tools
  ☆45Updated last week
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆149Updated 11 months ago
• xflops / flame
  A distributed engine for elastic workload, e.g. AI Agent, Quant
  ☆29Updated last week
• openshift / ib-sriov-cni
  InfiniBand SR-IOV CNI
  ☆14Updated this week
• heyfey / vodascheduler
  GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)
  ☆35Updated last year
• gpucloud / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆15Updated 6 years ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆132Updated last week
• fsspec / opendalfs
  OpenDAL fsspec integration
  ☆30Updated 4 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆33Updated 5 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆51Updated 8 months ago
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆24Updated 5 months ago