Alternatives and similar repositories for deepseek-api-arena

Users that are interested in deepseek-api-arena are comparing it to the libraries listed below

• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆41Updated 4 months ago
• simon-mo / vLLM-Benchmark
  ☆27Updated last month
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆31Updated 2 weeks ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆30Updated 5 months ago
• tensorchord / vechord
  Turn PostgreSQL into your search engine in a Pythonic way.
  ☆43Updated 3 weeks ago
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated 2 years ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆53Updated 6 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆254Updated last week
• noooop / wde
  Workflow Defined Engine
  ☆24Updated last month
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆20Updated last month
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆81Updated 2 weeks ago
• LLM-inference-router / vllm-router
  vLLM Router
  ☆29Updated last year
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆20Updated 3 weeks ago
• vllm-project / dashboard
  vLLM performance dashboard
  ☆30Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆132Updated 11 months ago
• 01-ai / Descartes
  ☆108Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆31Updated last month
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆61Updated 3 weeks ago
• banburytang / List-of-Chinese-Open-Source-Project-Financing
  ☆16Updated 2 years ago
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated last year
• InternLM / turbomind
  ☆85Updated 2 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆127Updated last month
• LMCache / demo
  ☆12Updated last month
• tensorchord / qtext
  ☆19Updated last year
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆32Updated 2 years ago
• wdlctc / headinfer
  ☆47Updated 2 weeks ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆158Updated 8 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆30Updated this week