Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)
☆61Jun 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for auto-tuning-vllm
Users that are interested in auto-tuning-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llm-d benchmark scripts and tooling☆62Updated this week
- Community maintained hardware plugin for vLLM on AWS Neuron☆33May 28, 2026Updated last month
- Header-only C++ library for writing PCP PMDAs☆16Feb 5, 2019Updated 7 years ago
- A series of high-performance GEMM (General Matrix Multiply) implementations Iteratively optimised for H100 GPUs in Pure CUDA.☆79Feb 18, 2026Updated 4 months ago
- ☆58Aug 1, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- redis module unit tests with python (deprecated) please see RLTest☆12Sep 8, 2019Updated 6 years ago
- MicroShift in Container☆58Jun 5, 2026Updated last month
- Digital SuperTwin: digital twin of supercomputers☆13Nov 24, 2024Updated last year
- htop.dev website☆13Nov 5, 2024Updated last year
- Simplified model deployment on llm-d☆29Jul 2, 2025Updated last year
- Ansible roles for the Performance Co-Pilot toolkit☆22Jun 26, 2026Updated last week
- A tool to detect infrastructure issues on cloud native AI systems☆53Sep 18, 2025Updated 9 months ago
- This project defines a json ontology standard describing a power consumption measure in a given software/hardware context, noticeably in …☆21Jun 3, 2026Updated last month
- Pure Java Protobuf tools☆35Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Skydive WebUI☆18Jan 7, 2023Updated 3 years ago
- Tips for running linux containers (LXC) on ChromeOS via Crostini☆18Feb 14, 2022Updated 4 years ago
- General Purpose Point Cloud Feature Extractor☆13Mar 1, 2018Updated 8 years ago
- Lightweight Performance Control System☆21Jul 1, 2026Updated last week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,346Updated this week
- Experimental extraction/refactoring of the Operator SDK's ansible operator plugin☆13Jun 25, 2026Updated last week
- DBus daemon for doing package action with the dnf package manager☆11Dec 20, 2023Updated 2 years ago
- SnapDocs - A Modern, Open-Source Document Workspace☆25Sep 7, 2025Updated 10 months ago
- ☆10Mar 28, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Neo4j Based Twitter Clone Backend☆15Nov 16, 2022Updated 3 years ago
- Practical Machine Learning with LightGBM and Python, published by Packt☆29Dec 15, 2025Updated 6 months ago
- Memory optimized Mixture of Experts☆78Jul 25, 2025Updated 11 months ago
- OpenCopilot flows editor☆11Oct 31, 2023Updated 2 years ago
- Linux System Roles website☆29Jul 1, 2026Updated last week
- testcloud is a small helper script to download and boot cloud images locally.☆13Jul 31, 2017Updated 8 years ago
- .NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.☆11Aug 24, 2023Updated 2 years ago
- Development containers for triton and triton-cpu☆28Jul 1, 2026Updated last week
- ☆32Oct 29, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A collection of single-host tests for Atomic Host☆18Nov 18, 2021Updated 4 years ago
- A Partytown plugin for Fresh☆12Oct 10, 2023Updated 2 years ago
- Internet Explorer Launcher (Launch the Internet Explorer on Windows 10/11)☆10May 23, 2024Updated 2 years ago
- A sub-RFC1928 SOCKS5 server implementation in Go with zero external dependencies.☆13Sep 5, 2023Updated 2 years ago
- Experiments with DSPy — declarative, trainable LLM pipelines. Notebooks and demos for evaluating, composing, and optimizing LLM workflows…☆10Jun 24, 2026Updated 2 weeks ago
- ☆14Nov 6, 2022Updated 3 years ago
- Model explanation provides the ability to interpret the effect of the predictors on the composition of an individual score.☆13Jan 21, 2021Updated 5 years ago