Benchmarking tool for vLLM inference performance with GPU monitoring
☆52Jun 7, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-benchmark-suite
Users that are interested in vllm-benchmark-suite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 5 months ago
- ☆19Oct 18, 2025Updated 10 months ago
- Anthropic's Contextual Retrieval implementation with visual chunk comparison. Preview context enrichment before/after embedding.☆30Sep 25, 2025Updated 11 months ago
- Detect and Deny - Deterministic Function-Level Guardrails for AI Agents☆18Jan 16, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆12Aug 1, 2025Updated last year
- 🔍 Dead-simple local file selector that preps your docs for LLM prompts, no cloud needed. Drop in your files, get perfectly formatted con…☆11Jan 11, 2025Updated last year
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆21Feb 15, 2026Updated 6 months ago
- A Node.js module to scrape and normalize links from an HTML string.☆15Apr 1, 2015Updated 11 years ago
- Serving hugging face guidance behind a server☆13Jun 14, 2023Updated 3 years ago
- This repository contains the Python code to estimate the Forward and Augmented DID estimators.☆12Dec 4, 2024Updated last year
- Automated install script for Steam & FEX on Ubuntu 24.04☆20Nov 10, 2025Updated 9 months ago
- Postgres-XL Deployment Tools☆18Jun 10, 2014Updated 12 years ago
- Asynchronous Distributed Key Value Pair database☆15Jan 17, 2014Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆25Aug 1, 2024Updated 2 years ago
- ☆42Feb 25, 2026Updated 6 months ago
- React higher-order component for using Azure Application Insights inside Next.js☆18Jan 4, 2023Updated 3 years ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 5 months ago
- My solution code to parallel architecture and programming Spring 2016☆12Aug 15, 2016Updated 10 years ago
- Code for "Mondrian Forests: Efficient Online Random Forests"☆20Nov 14, 2014Updated 11 years ago
- Implementation of BitNet1.58b☆15Jul 9, 2024Updated 2 years ago
- world's stupidest moe llm in 103M parameters☆20Jul 18, 2025Updated last year
- NVIDIA DGX Spark Playbooks☆18Nov 26, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Aug 15, 2026Updated 2 weeks ago
- ☆11Sep 27, 2024Updated last year
- DockaShell is an MCP server that gives AI agents isolated Docker containers to work in. MCP tools for shell access, file operations, and …☆30Jun 6, 2025Updated last year
- ☆10Nov 27, 2023Updated 2 years ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- ☆194Updated this week
- Open-source AI virtual assistant agent sandbox/runner with native UI client (OpenClaw/Chatbot alternative)☆34Jul 1, 2026Updated last month
- Tools to experiment with the LEGO® MINDSTORMS® Robot Inventor hub☆22Feb 9, 2021Updated 5 years ago
- A binding for Azure Functions to make working with Azure KeyVault easier.☆24Oct 18, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Aug 24, 2026Updated last week
- ☆14Aug 25, 2024Updated 2 years ago
- ☆58Oct 10, 2025Updated 10 months ago
- ☆11Jan 28, 2024Updated 2 years ago
- An agent that can run everywhere - even in your watch!☆34Apr 8, 2026Updated 4 months ago
- An injector for ISP injectors☆28Jan 17, 2016Updated 10 years ago
- ☆21Nov 21, 2022Updated 3 years ago