Benchmarking tool for vLLM inference performance with GPU monitoring
☆53Jun 7, 2026Updated 4 months ago
Alternatives and similar repositories for vllm-benchmark-suite
Users that are interested in vllm-benchmark-suite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 6 months ago
- Fast, self-contained desktop audiobook creator with optimized local Chatterbox TTS, voice cloning, EPUB/PDF/TXT support, and optional TTS…☆34Jul 18, 2026Updated 2 months ago
- ☆19Oct 18, 2025Updated 11 months ago
- ☆12Aug 1, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🔍 Dead-simple local file selector that preps your docs for LLM prompts, no cloud needed. Drop in your files, get perfectly formatted con…☆11Jan 11, 2025Updated last year
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆22Feb 15, 2026Updated 7 months ago
- Turn unstructured HTML pages into structured data. The OpenScraping library can extract information from HTML pages using a JSON config f…☆12Aug 23, 2018Updated 8 years ago
- Dynamic LLM RP Frontend☆24Updated this week
- A Node.js module to scrape and normalize links from an HTML string.☆15Apr 1, 2015Updated 11 years ago
- Serving hugging face guidance behind a server☆13Jun 14, 2023Updated 3 years ago
- Automated install script for Steam & FEX on Ubuntu 24.04☆20Nov 10, 2025Updated 11 months ago
- a mllm inference engine for academic research☆24Jan 30, 2026Updated 8 months ago
- Asynchronous Distributed Key Value Pair database☆15Jan 17, 2014Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆25Aug 1, 2024Updated 2 years ago
- ☆43Feb 25, 2026Updated 7 months ago
- React higher-order component for using Azure Application Insights inside Next.js☆18Jan 4, 2023Updated 3 years ago
- Python Bootcamp Materials☆11Dec 1, 2021Updated 4 years ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 6 months ago
- See how code changes affect your UI across viewports, themes, and languages☆15Jul 17, 2025Updated last year
- Code for "Mondrian Forests: Efficient Online Random Forests"☆20Nov 14, 2014Updated 11 years ago
- ☆21Jul 15, 2024Updated 2 years ago
- Train emoji embeddings based on emoji descriptions.☆18Mar 31, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NVIDIA DGX Spark Playbooks☆18Nov 26, 2025Updated 10 months ago
- ☆51Oct 1, 2025Updated last year
- Playable Bosses for Super Smash Bros. Ultimate.☆19Updated this week
- ☆11Sep 27, 2024Updated 2 years ago
- DockaShell is an MCP server that gives AI agents isolated Docker containers to work in. MCP tools for shell access, file operations, and …☆30Jun 6, 2025Updated last year
- ☆10Nov 27, 2023Updated 2 years ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- Dictionary of German medical terms for LibreOffice/OpenOffice/Android/Word☆13Apr 2, 2022Updated 4 years ago
- Container and workplace isolation for Claude Code and OpenClaw. Safely skip all permissions for claude.☆24Jul 4, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆271Updated this week
- piece for 3dmin's pushpull instrument☆15Dec 17, 2020Updated 5 years ago
- 🎮 Material You TUI for monitoring NVIDIA GPUs☆58Jan 16, 2026Updated 8 months ago
- ☆59Oct 10, 2025Updated last year
- ☆14Aug 25, 2024Updated 2 years ago
- ☆21Nov 21, 2022Updated 3 years ago
- YATSEE - Yet Another Tool for Speech Extraction & Enrichment☆32Jul 27, 2026Updated 2 months ago