A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
☆30Mar 28, 2025Updated 11 months ago
Alternatives and similar repositories for deepseek-api-arena
Users that are interested in deepseek-api-arena are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Vortex: A Flexible and Efficient Sparse Attention Framework☆49Jan 21, 2026Updated 2 months ago
- Go Client for jAccount☆12Jul 18, 2025Updated 8 months ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 2 months ago
- ☆53Mar 3, 2026Updated 3 weeks ago
- DEPRECATED, please use upstream at @sjtug☆13Dec 26, 2017Updated 8 years ago
- Repository for batch predict☆17Dec 1, 2021Updated 4 years ago
- ☆18Mar 11, 2026Updated last week
- KV cache store for distributed LLM inference☆399Nov 13, 2025Updated 4 months ago
- An experimental tool to modify YAMLs without losing (most of) comment lines.☆16Sep 25, 2022Updated 3 years ago
- Asynchronous pipeline parallel optimization☆19Feb 2, 2026Updated last month
- An experimental implementation of 'try' operator for Go☆13Jun 13, 2019Updated 6 years ago
- A Rust reimplementation of genai-bench for benchmarking LLM serving systems at high concurrency with accurate timing and industry-standar…☆279Mar 18, 2026Updated last week
- ☆19May 31, 2018Updated 7 years ago
- An experimental communicating attention kernel based on DeepEP.☆35Jul 29, 2025Updated 7 months ago
- AI-based search done right☆20Dec 25, 2025Updated 3 months ago
- Visualize your GitHub relationship using GitHub API v3 in JavaScript, Mathematica, Python or Scala.☆11Jul 15, 2015Updated 10 years ago
- Examples for QinYan GLMs☆13Sep 3, 2024Updated last year
- NVIDIA device plugin for Kubernetes☆15Sep 9, 2019Updated 6 years ago
- engula-operator creates/configures/manages engula clusters atop Kubernetes☆12Jan 5, 2022Updated 4 years ago
- Writing a CUDA software ray tracing renderer with Analysis-Driven Optimization from scratch: a python-importable, distributed parallel re…☆37Oct 5, 2025Updated 5 months ago
- my bachelor's thesis in SJTU about https://github.com/caicloud/cyclone☆12Jan 4, 2018Updated 8 years ago
- 滴滴云推理服务的 HTTP 客户端示例代码☆21Nov 21, 2022Updated 3 years ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆145Dec 4, 2024Updated last year
- ☆34Mar 1, 2026Updated 3 weeks ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated this week
- flex-block-attn: an efficient block sparse attention computation library☆127Dec 26, 2025Updated 2 months ago
- ☆13Jan 16, 2019Updated 7 years ago
- ☆94May 31, 2025Updated 9 months ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆26Apr 24, 2025Updated 11 months ago
- 🌈 Custom color scheme for github contribution bar. Created by @gigaflw☆34Nov 14, 2018Updated 7 years ago
- DeeperGEMM: crazy optimized version☆75May 5, 2025Updated 10 months ago
- vLLM performance dashboard☆43Apr 26, 2024Updated last year
- Unofficial GitLab Android client. Support self hosted GitLab and Push notifications☆10May 18, 2016Updated 9 years ago
- triton for dsa☆60Updated this week
- ☆10Nov 18, 2024Updated last year
- Website for CSE 234, Winter 2025☆13Mar 24, 2025Updated last year
- ☆11Jan 28, 2024Updated 2 years ago
- Cute layout visualization☆33Jan 18, 2026Updated 2 months ago
- ☆15Dec 5, 2025Updated 3 months ago