Benchmarking tool for vLLM inference performance with GPU monitoring
☆52Jun 7, 2026Updated last month
Alternatives and similar repositories for vllm-benchmark-suite
Users that are interested in vllm-benchmark-suite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 3 months ago
- Fast, self-contained desktop audiobook creator with optimized local Chatterbox TTS, voice cloning, EPUB/PDF/TXT support, and optional TTS…☆32Updated this week
- Anthropic's Contextual Retrieval implementation with visual chunk comparison. Preview context enrichment before/after embedding.☆30Sep 25, 2025Updated 9 months ago
- Detect and Deny - Deterministic Function-Level Guardrails for AI Agents☆18Jan 16, 2026Updated 6 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 🔍 Dead-simple local file selector that preps your docs for LLM prompts, no cloud needed. Drop in your files, get perfectly formatted con…☆11Jan 11, 2025Updated last year
- Agentic LLM RP Frontend☆22Updated this week
- This repository contains the Python code to estimate the Forward and Augmented DID estimators.☆12Dec 4, 2024Updated last year
- Automated install script for Steam & FEX on Ubuntu 24.04☆18Nov 10, 2025Updated 8 months ago
- Implementation of Active Anomaly Discovery (AAD) in Python☆15Dec 19, 2017Updated 8 years ago
- An online application for designers to give back to local governments and simultaneously build their portfolio.☆10Jun 20, 2011Updated 15 years ago
- ☆19Apr 13, 2026Updated 3 months ago
- Asynchronous Distributed Key Value Pair database☆15Jan 17, 2014Updated 12 years ago
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆25Aug 1, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆41Feb 25, 2026Updated 4 months ago
- Monitor large transactions on Polymarket and Kalshi prediction markets with anomaly detection☆25Feb 26, 2026Updated 4 months ago
- Python Bootcamp Materials☆11Dec 1, 2021Updated 4 years ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆17Mar 20, 2026Updated 4 months ago
- My solution code to parallel architecture and programming Spring 2016☆12Aug 15, 2016Updated 9 years ago
- ☆51Oct 1, 2025Updated 9 months ago
- ☆21Jul 15, 2024Updated 2 years ago
- Moral Operational Reasoning Assessment for Language Systems☆22Apr 8, 2026Updated 3 months ago
- Website for LLM360☆15Apr 27, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Train emoji embeddings based on emoji descriptions.☆18Mar 31, 2018Updated 8 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆32Apr 10, 2026Updated 3 months ago
- Distributed solver library for large-scale structured output prediction, based on Spark. Project website:☆17Mar 3, 2016Updated 10 years ago
- A tool for creating large database clusters quickly.☆21Dec 14, 2012Updated 13 years ago
- Sample project to build and run Turso's SQLite fork on iOS and use vector search functionality on device☆15Jul 26, 2024Updated last year
- ☆139Updated this week
- Container and workplace isolation for Claude Code and OpenClaw. Safely skip all permissions for claude.☆23Jul 4, 2026Updated 2 weeks ago
- ☆58Oct 10, 2025Updated 9 months ago
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Aug 25, 2024Updated last year
- ☆11Jan 28, 2024Updated 2 years ago
- YATSEE - Yet Another Tool for Speech Extraction & Enrichment☆31Jun 29, 2026Updated 3 weeks ago
- ☆21Nov 21, 2022Updated 3 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- Discord bot that will transcribe audio using OpenAI Whisper☆12Jun 6, 2023Updated 3 years ago
- Distributed Inference for mlx LLm☆102Aug 1, 2024Updated last year