Benchmarking the serving capabilities of vLLM
☆59Aug 20, 2024Updated last year
Alternatives and similar repositories for vllm-benchmark
Users that are interested in vllm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extending BookSim2.0 and HotSpot6.0 for Power, Performance and Thermal evaluation of 3D NoC Architectures☆14Aug 9, 2019Updated 6 years ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- ☆18Apr 12, 2017Updated 9 years ago
- An easy to use Julia framework for agent based modeling.☆13Dec 22, 2023Updated 2 years ago
- Demo code for Gemini Live Integration☆13Jul 29, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Feb 24, 2025Updated last year
- ☆14Jan 7, 2025Updated last year
- The driver for LMCache core to run in vLLM☆69Feb 4, 2025Updated last year
- Use smol agents to do research and then update csv coumns with its findings.☆42Jan 30, 2025Updated last year
- Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.☆12Jun 19, 2024Updated 2 years ago
- ☆11Jan 23, 2017Updated 9 years ago
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated last year
- This repository will collect and share awesome ChatGPT related papers and useful tools☆17Apr 2, 2023Updated 3 years ago
- Control Linux with plain English command☆16May 21, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Subsampled Graph-Based DBSCAN☆11Oct 21, 2020Updated 5 years ago
- Implementation of the Snappy compression algorithm as a RoCC accelerator☆12Jul 29, 2019Updated 6 years ago
- Graph partitioning for distributed GNN training☆13Mar 26, 2023Updated 3 years ago
- ☆12Dec 8, 2024Updated last year
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated 2 years ago
- A Natural Language Processing based approach to detect malicious HTTP requests.☆11Oct 2, 2020Updated 5 years ago
- ☆10Oct 8, 2021Updated 4 years ago
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- ☆12Aug 6, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Sep 8, 2019Updated 6 years ago
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- Deep Learning for HAR: models and tools for Human Activity Recognition from IMU sensor (accelerometer, gyroscope) data☆10Sep 16, 2020Updated 5 years ago
- ☆15Mar 24, 2023Updated 3 years ago
- ☆25Jan 28, 2026Updated 5 months ago
- 托福写作素材☆10Sep 7, 2022Updated 3 years ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- clone from http://git.infradead.org/users/dwmw2/vpnc-scripts.git/☆11Apr 24, 2026Updated 3 months ago
- Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs☆22Jul 14, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A hardware accelerated IP packet forwarder running on programmable ICs☆15Jan 21, 2023Updated 3 years ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- Evaluate your model using advanced prompt strategies☆21Jan 30, 2026Updated 5 months ago
- Computes graph connectivity for large graphs☆11Jan 30, 2017Updated 9 years ago
- A Deterministic Finite Automata GPU-based Engine☆17Sep 6, 2017Updated 8 years ago
- Allows testing of Server Sent Events☆22Jan 7, 2023Updated 3 years ago
- ☆57Nov 18, 2024Updated last year