Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)
☆64Jun 12, 2026Updated last month
Alternatives and similar repositories for auto-tuning-vllm
Users that are interested in auto-tuning-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,441Updated this week
- A performance testing and analysis automation framework☆16Updated this week
- ✨ GenAIOps Enablement Lab Instructions - https://rhoai-genaiops.github.io/lab-instructions☆16Jul 22, 2026Updated last week
- AI quickstart that provides interactive dashboard to analyze AI Model Performance as well as Openshift metrics collected from Prometheus☆25Jun 9, 2026Updated last month
- Synthetic Data Generation Toolkit for LLMs☆153Jul 20, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Models as a Service☆74Oct 21, 2025Updated 9 months ago
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆69Updated this week
- This is a git focused workshop!☆10Feb 15, 2023Updated 3 years ago
- ☆25Updated this week
- AI Agents Workshop with Red Hat AI☆13Feb 26, 2025Updated last year
- ☆26Jun 6, 2025Updated last year
- ☆19Updated this week
- Python library for Evaluation☆17Mar 31, 2026Updated 3 months ago
- Inference Platform Simulation☆21Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Time series forecasting and analytics, powered by machine learning☆11Mar 25, 2025Updated last year
- Benchmark and optimize LLM inference across frameworks with ease☆198Jul 14, 2026Updated 2 weeks ago
- ☆59Aug 1, 2025Updated 11 months ago
- Operator for the OpenShift Lightspeed Service☆15Updated this week
- Achieve state of the art inference performance with modern accelerators on Kubernetes☆3,898Updated this week
- AI-on-OpenShift website source code☆108Jun 22, 2026Updated last month
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆116Apr 30, 2026Updated 2 months ago
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆172Updated this week
- AIOps for Distributed Environments☆16Jul 22, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆17Mar 27, 2026Updated 4 months ago
- A lab/workshop for Red Hat OpenShift Data Science using simple fraud detection as an example workload☆21Jul 18, 2024Updated 2 years ago
- llm-d helm charts and deployment examples☆59May 1, 2026Updated 2 months ago
- An algorithm-focused interface for common llm training, continual learning, and reinforcement learning techniques☆86Updated this week
- A Golang library for analyzing k8s connectivity-configuration resources (a.k.a. network policies)☆19Feb 1, 2026Updated 5 months ago
- A workshop for new Red Hat interns (and others) as an introduction to building and debugging the Linux Kernel, as well as making some cha…☆22Feb 24, 2025Updated last year
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆660Updated this week
- Workshop prático sobre a plataforma de aplicações OpenShift (CaaS/PaaS)☆18Mar 27, 2020Updated 6 years ago
- Public repository for HPPS☆14Jan 26, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Agentic AI framework examples with Red Hat AI☆18Jul 2, 2025Updated last year
- SPDK fork of nvme-cli. No longer supported - use standard nvme-cli with SPDK nvme CUSE instead. See https://spdk.io/doc/nvme.html#nvme_…☆15Apr 10, 2024Updated 2 years ago
- Lola is able to package AI Context Modules or skills into a distributed package to be supported across multiple AI assistants. Think of y…☆111Updated this week
- ☆22Mar 11, 2026Updated 4 months ago
- htop.dev website☆13Nov 5, 2024Updated last year
- Hex encode & decode a string, right from your terminal.☆10Jan 5, 2023Updated 3 years ago
- ODH Tools & Extensions Companion☆30Feb 8, 2026Updated 5 months ago