Benchmarking the serving capabilities of vLLM
☆58Aug 20, 2024Updated last year
Alternatives and similar repositories for vllm-benchmark
Users that are interested in vllm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extending BookSim2.0 and HotSpot6.0 for Power, Performance and Thermal evaluation of 3D NoC Architectures☆14Aug 9, 2019Updated 6 years ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- Example of binding a TF32 CUTLASS GEMM kernel to PyTorch☆12Jun 7, 2024Updated 2 years ago
- Demo code for Gemini Live Integration☆13Jul 29, 2025Updated 11 months ago
- Automatic Thief Detection via CCTV with Alarm System and Perpetrator Image Capture using YOLOv5 + ROI. This project utilizes computer vis…☆19Oct 21, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Dec 29, 2022Updated 3 years ago
- The driver for LMCache core to run in vLLM☆66Feb 4, 2025Updated last year
- 在PyTorch上重构multi-agent deep deterministic policy gradient(MADDPG)，将https://github.com/xuemei-ye/maddpg-mpe 修改到自己电脑上可运行。因为本人笔记本没有CUDA，实验速度…☆14May 10, 2019Updated 7 years ago
- ☆14Jan 7, 2025Updated last year
- ☆33May 22, 2025Updated last year
- Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)☆19May 28, 2024Updated 2 years ago
- Flutter embedder for Tizen☆13Updated this week
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated 11 months ago
- Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.☆12Jun 19, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Graph partitioning for distributed GNN training☆13Mar 26, 2023Updated 3 years ago
- Implementation of the Snappy compression algorithm as a RoCC accelerator☆12Jul 29, 2019Updated 6 years ago
- Reference implementation of the paper "Efficient and Scalable Graph Generation through Iterative Local Expansion"☆17Aug 27, 2025Updated 10 months ago
- Rust crate for some audio utilities☆28Jun 17, 2026Updated 2 weeks ago
- 📊 Claude 绘图提示词集合，专注流程图、逻辑图、金字塔图等可视化内容创建。 📈 A collection of prompts for creating flowcharts, logic diagrams, pyramid charts and other vi…☆17Mar 5, 2025Updated last year
- ☆10Oct 8, 2021Updated 4 years ago
- ☆20May 27, 2025Updated last year
- An easy to use Julia framework for agent based modeling.☆13Dec 22, 2023Updated 2 years ago
- ☆14Sep 8, 2019Updated 6 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- Network on chip based neural network accelerator☆11Mar 25, 2021Updated 5 years ago
- Reproducible Bayesian data analysis pipelines with targets and JAGS☆11Dec 3, 2024Updated last year
- ☆14Sep 18, 2024Updated last year
- LLM-DSE: Searching Accelerator Parameters with LLM Agents☆16May 22, 2025Updated last year
- ☆10Dec 28, 2020Updated 5 years ago
- ☆20Oct 5, 2025Updated 9 months ago
- [ACL 2025 Main] (🏆 Outstanding Paper Award) Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Proba…☆18Aug 15, 2025Updated 10 months ago
- ☆26May 8, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Finetuning a codegen model with python instruction set using QLORA technique for better efficacy☆11Aug 31, 2023Updated 2 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- Moondream MCP Server in Python☆49Jul 2, 2025Updated last year
- Interactive textbook on state space models☆12Apr 11, 2022Updated 4 years ago
- Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs☆22May 8, 2026Updated last month
- Fork of the gem5 simulator with Garnet2.0 and DSENT extensions☆12Jan 28, 2019Updated 7 years ago
- ☆18May 31, 2024Updated 2 years ago