Benchmarking the serving capabilities of vLLM
☆59Aug 20, 2024Updated 2 years ago
Alternatives and similar repositories for vllm-benchmark
Users that are interested in vllm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- finite-state toolkit☆12May 5, 2017Updated 9 years ago
- Data and tools for processing Georgian texts☆10Dec 4, 2016Updated 9 years ago
- gpu的显存使用监控☆12Mar 4, 2024Updated 2 years ago
- SGLang is fast serving framework for large language models and vision language models.☆38Aug 21, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The Security Toolkit for managing Generative AI(especially LLMs) and Supervised Learning processes(Learning and Inference).☆23Jun 25, 2025Updated last year
- Daily.co + Pipecat + Tavus AI Avatar Agent☆16Apr 19, 2025Updated last year
- ☆13Oct 13, 2021Updated 5 years ago
- ☆14Jan 7, 2025Updated last year
- Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)☆19May 28, 2024Updated 2 years ago
- The website of the Oscar Project☆11Mar 27, 2025Updated last year
- The driver for LMCache core to run in vLLM☆70Feb 4, 2025Updated last year
- Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.☆13Jun 19, 2024Updated 2 years ago
- ☆22Sep 30, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Realtime voice assistant powered by Groq's whisper API, Groq's Llama and ElevenLabs text-to-speech☆56Jul 8, 2024Updated 2 years ago
- This repository holds the data and code for the AndroR2 dataset of manually-reproduced bug reports for Android apps☆27Jun 11, 2021Updated 5 years ago
- This app leverages React.js on the frontend and Nest.js, on the backend along with WebSockets Gateway to provide a seamless real-time col…☆13Apr 29, 2024Updated 2 years ago
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated last year
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- ☆11Aug 6, 2024Updated 2 years ago
- Reinforcement Learning in LLM Tutorial (Python) from scratch☆36Jan 28, 2026Updated 8 months ago
- ☆14Sep 18, 2024Updated 2 years ago
- scraper for Rensselaer Polytechnic Institute (RPI)'s Covid Dashboard☆13Jun 4, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- ☆25Jan 28, 2026Updated 8 months ago
- Evaluate your model using advanced prompt strategies☆21Jan 30, 2026Updated 8 months ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- Finetuning a codegen model with python instruction set using QLORA technique for better efficacy☆11Aug 31, 2023Updated 3 years ago
- ☆58Nov 18, 2024Updated last year
- This repository contains a Python implementation that allows you to use gorilla-llm/gorilla-openfunctions-v2 LLM to perform function call…☆17Apr 7, 2024Updated 2 years ago
- a fun and educational take on vLLM☆230Jan 25, 2026Updated 8 months ago
- A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTor…☆15Feb 27, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A dual-chatbot system for learning languages based on LangChain☆14Jun 25, 2023Updated 3 years ago
- ☆156Oct 7, 2026Updated last week
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- A modified version of searx (the privacy-respecting metasearch engine) to only search an allowlist of sites, to build functionality simil…☆19Sep 17, 2021Updated 5 years ago
- ☆18Sep 16, 2026Updated last month
- 关联分析: 频繁项集、关联规则☆12Jul 31, 2014Updated 12 years ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 4 months ago