tensorchord / deepseek-api-arena
A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
☆29Updated last month
Alternatives and similar repositories for deepseek-api-arena
Users that are interested in deepseek-api-arena are comparing it to the libraries listed below
Sorting:
- The driver for LMCache core to run in vLLM☆39Updated 3 months ago
- This repository contains statistics about the AI Infrastructure products.☆18Updated 2 months ago
- ☆25Updated 3 weeks ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆51Updated 6 months ago
- ☆45Updated 2 weeks ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆100Updated last year
- Workflow Defined Engine☆24Updated 3 weeks ago
- KV cache store for distributed LLM inference☆190Updated last week
- ☆84Updated last month
- vLLM Router☆29Updated last year
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆29Updated 4 months ago
- vLLM performance dashboard☆27Updated last year
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆132Updated 11 months ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆14Updated last week
- Deploy ChatGLM on Modelz☆15Updated 2 years ago
- support BM25+vecetor☆28Updated 5 months ago
- Turn PostgreSQL into your search engine in a Pythonic way.☆42Updated last month
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆73Updated 2 weeks ago
- ☆108Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated 11 months ago
- xet client tech, used in huggingface_hub☆95Updated this week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆155Updated 7 months ago
- Auto Thinking Mode switch for Qwen3 in Open webui☆60Updated last week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆17Updated 3 weeks ago
- ☆11Updated this week
- ☆32Updated last week
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆126Updated 2 weeks ago
- ☆16Updated 2 years ago
- ☆25Updated 2 months ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆80Updated 11 months ago