tensorchord / deepseek-api-arena
A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
☆29Updated 3 weeks ago
Alternatives and similar repositories for deepseek-api-arena:
Users that are interested in deepseek-api-arena are comparing it to the libraries listed below
- This repository contains statistics about the AI Infrastructure products.☆18Updated last month
- Workflow Defined Engine☆23Updated last week
- The driver for LMCache core to run in vLLM☆36Updated 2 months ago
- Turn PostgreSQL into your search engine in a Pythonic way.☆39Updated last week
- Deploy ChatGLM on Modelz☆15Updated 2 years ago
- xet client tech, used in huggingface_hub☆86Updated this week
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆131Updated 10 months ago
- ☆44Updated last week
- KV cache store for distributed LLM inference☆151Updated 3 weeks ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆29Updated 4 months ago
- A distributed engine for intelligent workload☆27Updated 2 months ago
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆25Updated last year
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆49Updated 5 months ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆17Updated this week
- vLLM Router☆26Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆80Updated 11 months ago
- ☆108Updated last year
- Model Context Protocol Server for Apache OpenDAL™☆28Updated 2 weeks ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆197Updated 3 weeks ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆43Updated last month
- Yet another coding assistant powered by LLM.☆16Updated 7 months ago
- CursorCore: Assist Programming through Aligning Anything☆118Updated 2 months ago
- Open-source observability for your LLM application.☆51Updated 3 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆125Updated 3 weeks ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆154Updated 7 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆17Updated 11 months ago
- vLLM adapter for a TGIS-compatible gRPC server.☆26Updated this week
- ☆19Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆97Updated last year
- Backend server for envd☆20Updated last year