An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters
☆66Mar 12, 2026Updated 5 months ago
Alternatives and similar repositories for vllm-tuner
Users that are interested in vllm-tuner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A minimalist but optimized Python package for deduplication tasks leveraging RapidFuzz internally, enabling super-fast approximate duplic…☆18Apr 2, 2025Updated last year
- ☆14Aug 14, 2023Updated 3 years ago
- Waypoints & Animations for Shiny☆18Jan 30, 2020Updated 6 years ago
- GLiNER2 Rust support☆19Updated this week
- WebApp in RShiny using the package itunesr for iTunes AppStore Review Extraction and Analysis☆10Mar 3, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆11Jul 9, 2019Updated 7 years ago
- A CLI to estimate inference memory requirements for Hugging Face models, written in Python.☆938Jul 27, 2026Updated 3 weeks ago
- An agentic system that reads research papers (local PDFs or arXiv), generates implementation plans, writes code, and reviews it — all orc…☆24Apr 26, 2026Updated 3 months ago
- ☆15Dec 15, 2023Updated 2 years ago
- [On-CRAN] Create Datasets with Hidden Images or Messages in Residual Plots☆19Jan 11, 2026Updated 7 months ago
- Markdown syntax for HTML Details Tag with support across interactive (html) and non-interactive (latex, typst, word, ...).☆16Dec 28, 2025Updated 7 months ago
- A lightweight adjustment tool for smoothing token probabilities in the Qwen models to encourage balanced multilingual generation.☆107Jul 9, 2025Updated last year
- GPU Cluster Monitoring (GCM): Large-Scale AI Research Cluster Monitoring☆235Updated this week
- ☆17May 22, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆91Feb 10, 2026Updated 6 months ago
- Edge Weight Prediction For Category-Agnostic Pose Estimation☆51Feb 14, 2026Updated 6 months ago
- This is the sample repo used for the Introduction to Reproducible Publications with Quarto lesson. It contains the datasets, figures, and…☆13Jul 24, 2025Updated last year
- NL2Flow: A PDDL Interface to Flow Construction☆16Dec 4, 2025Updated 8 months ago
- A python Package that lets users use 4 different face detector by just changing a single line of code☆20Apr 26, 2021Updated 5 years ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated last year
- This repository is an open source implementation of the MuonClip strategy from the KIMI K2 Model from Moonshot AI☆29Nov 7, 2025Updated 9 months ago
- 🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹☆23Aug 2, 2025Updated last year
- 🚀 Lightweight Python library for building production LLM applications with smart context management and automatic token optimization. Sa…☆39Apr 12, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Adaptive Chunking: automatically select the best chunking method per document for RAG. Accepted at LREC 2026.☆376Jul 6, 2026Updated last month
- Workshop material for DuckDB workshop at Pydata DE☆15Sep 1, 2025Updated 11 months ago
- ☆37Mar 2, 2026Updated 5 months ago
- ☆19Apr 15, 2025Updated last year
- ☆22Jun 5, 2025Updated last year
- 📄◻️ Create, Maniuplate and Extract Data from PDF Files (R Apache PDFBox wrapper)☆43Jan 15, 2019Updated 7 years ago
- ☆16Jun 25, 2026Updated last month
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆35Aug 21, 2025Updated 11 months ago
- Efficient few-shot learning with cross-encoders.☆68Feb 16, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Modal-style sandbox API on top of Hugging Face Jobs☆159Jul 6, 2026Updated last month
- ☆34Updated this week
- ☆34May 31, 2025Updated last year
- ShopME: An E2E fashion recommendation System☆20May 25, 2026Updated 2 months ago
- [CRAN-Submission-Ready] Architect Dockerfiles☆28Sep 4, 2025Updated 11 months ago
- ☆23Jan 10, 2025Updated last year
- Oh, this is for learning orchestration and for gluing together specialist agents, not for building LLMs-with-tools from scratch☆15Mar 20, 2026Updated 4 months ago