An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters
☆66Mar 12, 2026Updated 8 months ago
Alternatives and similar repositories for vllm-tuner
Users that are interested in vllm-tuner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NucleusIQ is an open-source Agent first framework☆24Nov 3, 2026Updated last week
- ☆14Aug 14, 2023Updated 3 years ago
- Qwen3.8-27B on one A100: up to 14.2x single-turn and 8.2x multi-turn vs bf16 on stock vLLM. Four profiles tuned per use case (c1m, c1s, c…☆42Updated this week
- A minimalist but optimized Python package for deduplication tasks leveraging RapidFuzz internally, enabling super-fast approximate duplic…☆18Apr 2, 2025Updated last year
- 실제 한국어 문서 데이터셋을 기반으로 만든 3가지 VLM 벤치마크 데이터셋☆32Jul 28, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GLiNER2 Rust support☆21Aug 29, 2026Updated 2 months ago
- Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-b…☆26Sep 30, 2026Updated last month
- ☆16Mar 1, 2026Updated 8 months ago
- WebApp in RShiny using the package itunesr for iTunes AppStore Review Extraction and Analysis☆10Mar 3, 2020Updated 6 years ago
- ☆11Jul 9, 2019Updated 7 years ago
- hello-mcp is a tour and guide for beginners to Claude Desktop MCP Config Manager, designed to help them understand MCP (Model Context Pro…☆13Mar 29, 2025Updated last year
- A CLI to estimate inference memory requirements for Hugging Face models, written in Python.☆950Updated this week
- Manage R Configuration at the Command Line☆27Oct 27, 2026Updated 2 weeks ago
- DSPydantic: Auto-Optimize Your Prompts and Pydantic Models with DSPy☆333Sep 28, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [On-CRAN] Systematically deploy files across multiple GitHub repositories☆18Aug 22, 2025Updated last year
- Claude code slash commands creation for session management☆14Sep 13, 2025Updated last year
- Statistically-Lossless Quantization of Large Language Models☆63Oct 8, 2026Updated last month
- PCaDB - a comprehensive and interactive database for transcriptomes from prostate cancer population cohorts☆10Dec 29, 2021Updated 4 years ago
- An agentic system that reads research papers (local PDFs or arXiv), generates implementation plans, writes code, and reviews it — all orc…☆25Apr 26, 2026Updated 6 months ago
- Async value functions and replay-buffer critic training for PRIME-RL☆24Updated this week
- ☆13Dec 17, 2025Updated 10 months ago
- ☆31Oct 27, 2026Updated 2 weeks ago
- AutoRAG example about benchmarking Korean embeddings.☆46Oct 2, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Oct 31, 2026Updated 2 weeks ago
- Knowledge graph + MCP tool server for LLM agents with hybrid retrieval, live DB sync, Korean FTS, and memory feedback.☆33Jul 3, 2026Updated 4 months ago
- ☆17Oct 30, 2026Updated 2 weeks ago
- Organisation du soutien entre agents : moyens engagés, idées, etc.☆15Mar 19, 2020Updated 6 years ago
- A comprehensive Python package for multi-class and multi-label text classification using Large Language Models (LLMs) and traditional mac…☆14Updated this week
- Sovereign programming language for the Apple Neural Engine: .cy source -> HWX Mach-O binaries + organism VM, on-chip grad/Adam, compile-t…☆17Nov 6, 2026Updated last week
- Dissecting the effects of DNA copy number variations on transcriptional programs at single-cell resolution☆14Feb 13, 2026Updated 9 months ago
- digitalDLSorteR: An R package to deconvolute bulk RNA-Seq using scRNA-Seq data☆16Oct 31, 2024Updated 2 years ago
- A fast AWS S3 browser, with inspiration from s5cmd☆14May 29, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Apr 19, 2026Updated 6 months ago
- Workshop material for DuckDB workshop at Pydata DE☆15Sep 1, 2025Updated last year
- A lightweight adjustment tool for smoothing token probabilities in the Qwen models to encourage balanced multilingual generation.☆110Jul 9, 2025Updated last year
- ☆17Updated this week
- Adaptive Chunking: automatically select the best chunking method per document for RAG. Accepted at LREC 2026.☆402Jul 6, 2026Updated 4 months ago
- Initialization scripts for interactive services☆15Dec 22, 2025Updated 10 months ago
- User-friendly bulk RNAseq deconvolution using simulated annealing☆18Feb 8, 2024Updated 2 years ago
Are these results useful?