Benchmarking tool for vLLM inference performance with GPU monitoring
☆53Jun 7, 2026Updated 3 months ago
Alternatives and similar repositories for vllm-benchmark-suite
Users that are interested in vllm-benchmark-suite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Fast, self-contained desktop audiobook creator with optimized local Chatterbox TTS, voice cloning, EPUB/PDF/TXT support, and optional TTS…☆33Jul 18, 2026Updated 2 months ago
- Anthropic's Contextual Retrieval implementation with visual chunk comparison. Preview context enrichment before/after embedding.☆31Sep 25, 2025Updated 11 months ago
- Detect and Deny - Deterministic Function-Level Guardrails for AI Agents☆18Jan 16, 2026Updated 8 months ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆22Feb 15, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Dynamic LLM RP Frontend☆23Updated this week
- CAD files for DDR5 RDIMM cooling☆16Jun 12, 2025Updated last year
- Automated install script for Steam & FEX on Ubuntu 24.04☆20Nov 10, 2025Updated 10 months ago
- Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it acro…☆22Updated this week
- Asynchronous Distributed Key Value Pair database☆15Jan 17, 2014Updated 12 years ago
- Python Bootcamp Materials☆11Dec 1, 2021Updated 4 years ago
- GPU overclocking utility for Blackwell RTX 50-series on Linux☆24May 26, 2026Updated 3 months ago
- My solution code to parallel architecture and programming Spring 2016☆12Aug 15, 2016Updated 10 years ago
- R Bootcamp Materials☆19Oct 13, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆51Oct 1, 2025Updated 11 months ago
- NVIDIA DGX Spark Playbooks☆18Nov 26, 2025Updated 9 months ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Aug 15, 2026Updated last month
- Playable Bosses for Super Smash Bros. Ultimate.☆20Sep 14, 2026Updated last week
- ☆11Sep 27, 2024Updated last year
- Files necessary to add Hologram Dash and Hologram Dash Pro boards to the Arduino IDE☆13Feb 12, 2018Updated 8 years ago
- DockaShell is an MCP server that gives AI agents isolated Docker containers to work in. MCP tools for shell access, file operations, and …☆30Jun 6, 2025Updated last year
- ☆10Nov 27, 2023Updated 2 years ago
- ☆254Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Container and workplace isolation for Claude Code and OpenClaw. Safely skip all permissions for claude.☆23Jul 4, 2026Updated 2 months ago
- ☆14Aug 25, 2024Updated 2 years ago
- ☆59Oct 10, 2025Updated 11 months ago
- ☆11Jan 28, 2024Updated 2 years ago
- An agent that can run everywhere - even in your watch!☆34Apr 8, 2026Updated 5 months ago
- A website for converting transliterated neo-Assyrian/Babylonion into cuneiform, based on Steve Tinney's cuneify.☆10Oct 14, 2024Updated last year
- ☆21Nov 21, 2022Updated 3 years ago
- This app lets you easily control your server’s fan speeds remotely using IPMI. Simply enter your server’s IP, username, and password, the…☆30Sep 9, 2026Updated last week
- YATSEE - Yet Another Tool for Speech Extraction & Enrichment☆32Jul 27, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code and sample images described in the paper "DeepScribe: Localization and Classification of Elamite Cuneiform Signs Via Deep Learning"☆15Dec 29, 2024Updated last year
- ☆12Sep 21, 2024Updated 2 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 3 years ago
- Discord bot that will transcribe audio using OpenAI Whisper☆12Jun 6, 2023Updated 3 years ago
- Hyperstar: Negative Sampling Improves Hypernymy Extraction Based on Projection Learning.☆24Jan 2, 2020Updated 6 years ago
- Parser and printer for the opam file syntax☆16Jul 3, 2025Updated last year