Benchmarking the serving capabilities of vLLM
☆58Aug 20, 2024Updated 2 years ago
Alternatives and similar repositories for vllm-benchmark
Users that are interested in vllm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- c++ implementation of mmpose inference, for pose estimation based on MNN☆13Mar 9, 2021Updated 5 years ago
- Repo containing data and code for serverless paper☆10Jun 23, 2023Updated 3 years ago
- ☆15Dec 29, 2022Updated 3 years ago
- ☆14Jan 7, 2025Updated last year
- ☆12Aug 2, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The website of the Oscar Project☆11Mar 27, 2025Updated last year
- ☆10Jan 9, 2023Updated 3 years ago
- The driver for LMCache core to run in vLLM☆71Feb 4, 2025Updated last year
- ☆20Sep 9, 2026Updated last month
- ☆13Oct 13, 2021Updated 5 years ago
- Yet another coding assistant powered by LLM.☆16Sep 11, 2024Updated 2 years ago
- ☆13Sep 30, 2022Updated 4 years ago
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated 2 years ago
- ☆11Jan 23, 2017Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Network on chip based neural network accelerator☆11Mar 25, 2021Updated 5 years ago
- Subsampled Graph-Based DBSCAN☆11Oct 21, 2020Updated 6 years ago
- ☆14Sep 8, 2019Updated 7 years ago
- ☆10Dec 28, 2020Updated 5 years ago
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated last year
- Accelerating LLM inference with techniques like speculative decoding, quantization, and kernel fusion, focusing on implementing state-of-…☆11Jul 1, 2025Updated last year
- ☆15Mar 24, 2023Updated 3 years ago
- ☆25Jan 28, 2026Updated 9 months ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆12Apr 11, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆22Sep 30, 2026Updated last month
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- 💥 Tiny 9M MoEs with Dynamic Routing☆13May 29, 2024Updated 2 years ago
- This repository will collect and share awesome ChatGPT related papers and useful tools☆17Apr 2, 2023Updated 3 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- Collection of different communication methods for chip mulitprocessors☆13Jul 20, 2026Updated 3 months ago
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"☆16Mar 6, 2025Updated last year
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Embeddable, self-hosted AI chat widget for your docs — a single Cloudflare Worker that retrieves your documentation and streams cited Ope…☆12Updated this week
- ☆14Sep 18, 2024Updated 2 years ago
- Computes graph connectivity for large graphs☆11Jan 30, 2017Updated 9 years ago
- OpenAES library exported from☆14Dec 29, 2023Updated 2 years ago
- 小飞机翻墙教程☆24Nov 14, 2019Updated 6 years ago
- [EMNLP 2025] The official implementation of "Zero-shot Multimodal Document Retrieval via Cross-Modal Question Generation"☆14Aug 26, 2025Updated last year
- A Deterministic Finite Automata GPU-based Engine☆17Sep 6, 2017Updated 9 years ago