Alternatives and similar repositories for deepseek-api-arena:

Users that are interested in deepseek-api-arena are comparing it to the libraries listed below

• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated last month
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆35Updated last month
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated 2 years ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆57Updated this week
• LLM-inference-router / vllm-router
  vLLM Router
  ☆24Updated last year
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆15Updated 6 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆93Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆44Updated 4 months ago
• 01-ai / Descartes
  ☆107Updated 11 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆130Updated 9 months ago
• wdlctc / headinfer
  ☆39Updated last month
• julien-c / arxiv-to-hf
  Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page
  ☆25Updated last year
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆17Updated 10 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated 6 months ago
• Ascend / torchair
  ☆10Updated this week
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆51Updated 2 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆78Updated this week
• tyler-griggs / melange-release
  ☆45Updated 9 months ago
• InternLM / turbomind
  ☆74Updated 3 months ago
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆76Updated this week
• appl-team / reppl
  Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts
  ☆43Updated 2 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated last month
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆29Updated 3 months ago
• microsoft / AttentionEngine
  ☆51Updated 2 weeks ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆150Updated 6 months ago
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆40Updated last month
• pingcap / tidb-vector-python
  TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p
  ☆53Updated 4 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆73Updated last month
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆61Updated last week