Alternatives and similar repositories for deepseek-api-arena

Users that are interested in deepseek-api-arena are comparing it to the libraries listed below

• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 months ago
• simon-mo / vLLM-Benchmark
  ☆28Updated 2 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆42Updated 4 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆53Updated 7 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆151Updated this week
• LLM-inference-router / vllm-router
  vLLM Router
  ☆29Updated last year
• GeeeekExplorer / transformers-patch
  patches for huggingface transformers to save memory
  ☆23Updated 3 weeks ago
• noooop / wde
  Workflow Defined Engine
  ☆24Updated 2 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆269Updated 2 weeks ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆87Updated last month
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆133Updated last year
• LMCache / demo
  ☆13Updated 2 months ago
• InternLM / turbomind
  ☆86Updated 3 months ago
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated 2 years ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• bytedance-iaas / splitwise-demos
  ☆26Updated 3 months ago
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated last year
• bentoml / llm-bench
  ☆54Updated 7 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆32Updated this week
• microsoft / AttentionEngine
  ☆71Updated last month
• SomeoneKong / llm_long_context_bench202405
  ☆30Updated 9 months ago
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆20Updated last month
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆118Updated this week
• knoway-dev / knoway
  An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
  ☆20Updated 2 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆38Updated 3 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• wdlctc / headinfer
  ☆50Updated last month
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆65Updated last month
• secsilm / chinese-tokens-in-tiktoken
  Chinese tokens in tiktoken tokenizers.
  ☆32Updated last year
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆219Updated 2 months ago