Benchmarking the serving capabilities of vLLM
☆59Aug 20, 2024Updated 2 years ago
Alternatives and similar repositories for vllm-benchmark
Users that are interested in vllm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extending BookSim2.0 and HotSpot6.0 for Power, Performance and Thermal evaluation of 3D NoC Architectures☆14Aug 9, 2019Updated 7 years ago
- Demo code for Gemini Live Integration☆13Jul 29, 2025Updated last year
- ☆14Jan 7, 2025Updated last year
- Use smol agents to do research and then update csv coumns with its findings.☆42Jan 30, 2025Updated last year
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Meditation generation using streamlit, OpenAI GPT and Google TTS☆10Mar 17, 2025Updated last year
- Implementation of the Snappy compression algorithm as a RoCC accelerator☆12Jul 29, 2019Updated 7 years ago
- Graph partitioning for distributed GNN training☆13Mar 26, 2023Updated 3 years ago
- ☆10Oct 8, 2021Updated 4 years ago
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- ☆14Sep 8, 2019Updated 6 years ago
- Bus Pirate 5 Hardware Documentation☆13May 28, 2025Updated last year
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- ☆14Sep 18, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A simple cycle accurate template model for ASIC/FPGA hardware design. Including a cycle accurate FIFO design example. More designs are co…☆17Sep 5, 2019Updated 7 years ago
- ☆25Jan 28, 2026Updated 7 months ago
- 托福写作素材☆10Sep 7, 2022Updated 4 years ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- Automatically take screenshots of comments!☆10Jan 30, 2022Updated 4 years ago
- A hardware accelerated IP packet forwarder running on programmable ICs☆15Jan 21, 2023Updated 3 years ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- [EMNLP 2025] The official implementation of "Zero-shot Multimodal Document Retrieval via Cross-Modal Question Generation"☆15Aug 26, 2025Updated last year
- Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"☆15Mar 6, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fork of the gem5 simulator with Garnet2.0 and DSENT extensions☆13Jan 28, 2019Updated 7 years ago
- NoC based MPSoC☆11Jul 17, 2014Updated 12 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- simple roboticarm view for urdf☆15Sep 19, 2025Updated 11 months ago
- ☆58Nov 18, 2024Updated last year
- a fun and educational take on vLLM☆225Jan 25, 2026Updated 7 months ago
- This repository contains a Python implementation that allows you to use gorilla-llm/gorilla-openfunctions-v2 LLM to perform function call…☆17Apr 7, 2024Updated 2 years ago
- Automatic Thief Detection via CCTV with Alarm System and Perpetrator Image Capture using YOLOv5 + ROI. This project utilizes computer vis…☆22Oct 21, 2024Updated last year
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A dual-chatbot system for learning languages based on LangChain☆14Jun 25, 2023Updated 3 years ago
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- FlappyBird愤怒的小鸟 c++游戏实现 学习代码☆10Nov 16, 2018Updated 7 years ago
- imported from https://dangerous-prototypes-open-hardware.googlecode.com/svn/branches/pyBusPirate☆15Jul 24, 2020Updated 6 years ago
- A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTor…☆15Feb 27, 2024Updated 2 years ago
- StealthRL: RL framework for adversarially paraphrasing AI text to stress-test detector robustness.☆19Jun 1, 2026Updated 3 months ago
- ☆15May 10, 2019Updated 7 years ago