Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)
☆64Aug 19, 2026Updated 2 weeks ago
Alternatives and similar repositories for auto-tuning-vllm
Users that are interested in auto-tuning-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- helm charts for deploying models with llm-d☆32Updated this week
- A Python-based tool, trained on the state-of-the-art Google Pegasus model, specializing in generating abstracts from given YouTube video …☆10Aug 6, 2023Updated 3 years ago
- llm-d benchmark scripts and tooling☆67Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,588Updated this week
- Starter kits for building and deploying AI agents. Run interactively locally or deploy to Red Hat OpenShift (including RHOAI) via OGX.☆30Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A performance testing and analysis automation framework☆16Updated this week
- ✨ GenAIOps Enablement Lab Instructions - https://rhoai-genaiops.github.io/lab-instructions☆16Updated this week
- AI quickstart that provides interactive dashboard to analyze AI Model Performance as well as Openshift metrics collected from Prometheus☆26Jun 9, 2026Updated 2 months ago
- Synthetic Data Generation Toolkit for LLMs☆160Updated this week
- Models as a Service☆75Oct 21, 2025Updated 10 months ago
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆70Aug 25, 2026Updated last week
- This is a git focused workshop!☆10Feb 15, 2023Updated 3 years ago
- ☆28Updated this week
- A Python library for inference-time scaling LLMs☆38Aug 24, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Simplified model deployment on llm-d☆28Jul 2, 2025Updated last year
- AI Agents Workshop with Red Hat AI☆13Feb 26, 2025Updated last year
- ☆27Jun 6, 2025Updated last year
- ☆19Updated this week
- Python library for Evaluation☆16Aug 21, 2026Updated 2 weeks ago
- Inference Platform Simulation☆29Updated this week
- Time series forecasting and analytics, powered by machine learning☆11Mar 25, 2025Updated last year
- Benchmark and optimize LLM inference across frameworks with ease☆202Jul 14, 2026Updated last month
- ☆59Aug 1, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Operator for the OpenShift Lightspeed Service☆16Updated this week
- Achieve state of the art inference performance with modern accelerators on Kubernetes☆4,439Updated this week
- AI-on-OpenShift website source code☆108Aug 24, 2026Updated 2 weeks ago
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆195Updated this week
- AIOps for Distributed Environments☆17Aug 30, 2026Updated last week
- GenAI inference performance benchmarking tool☆238Updated this week
- redis module unit tests with python (deprecated) please see RLTest☆12Sep 8, 2019Updated 6 years ago
- A lab/workshop for Red Hat OpenShift Data Science using simple fraud detection as an example workload☆21Jul 18, 2024Updated 2 years ago
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,200Apr 30, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An algorithm-focused interface for common llm training, continual learning, and reinforcement learning techniques☆94Updated this week
- A Golang library for analyzing k8s connectivity-configuration resources (a.k.a. network policies)☆20Feb 1, 2026Updated 7 months ago
- Digital SuperTwin: digital twin of supercomputers☆13Nov 24, 2024Updated last year
- ☆40Updated this week
- Header-only C++ library for writing PCP PMDAs☆16Feb 5, 2019Updated 7 years ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆812Updated this week
- Workshop prático sobre a plataforma de aplicações OpenShift (CaaS/PaaS)☆18Mar 27, 2020Updated 6 years ago