Real-time terminal UI dashboard for monitoring vLLM
☆35Jul 13, 2026Updated 3 months ago
Alternatives and similar repositories for vllm-monitor
Users that are interested in vllm-monitor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Per-session analytics for Hermes Desktop: tokens, cache, cost, failures, files — plus Ask AI analysis☆15Sep 27, 2026Updated last month
- Validate the usable size of your local LLM cache under pressure☆12Sep 26, 2026Updated last month
- Docker compose serving stack for DeepSeek v4 Flash DSpark for NVIDIA Spark GB10 system using Aidendle94 image☆33Aug 30, 2026Updated 2 months ago
- 【Hermes 桌面端插件 v3.7.7】外观整合浮窗——双栏面板、悬停即见简介、主题自动跟随官方(含 Ink & Paper 灰阶与 Binshao 暖纸)、纸纹模拟、霞鹜文楷、界面缩放与聊天文字大小、窗口透明(玻璃)、开场标识、消息气泡、对话行为五件套，状态栏一键设置，…☆16Updated this week
- ⏳Time, but only when it matters. A Hermes plugin for tacit temporal awareness.☆24Oct 27, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans GPU memory, checks models for security, benchmarks, …☆18Oct 27, 2026Updated last week
- Windows-native local dictation. Hold a hotkey, speak, release — cleaned-up words appear in the focused app. Parakeet TDT v3 ASR + LlamaSh…☆18Aug 25, 2026Updated 2 months ago
- Gitdeck is a terminal UI for managing multiple Git repositories under one folder. It scans a workspace, shows each repo’s status, and let…☆21Jul 12, 2026Updated 3 months ago
- Zam Matrix Client☆14Updated this week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆65Updated this week
- YouTube competitor tracking + content pipeline skill for Claude Code / OpenClaw agents☆14Mar 13, 2026Updated 7 months ago
- Wrap commands that might cause out-of-memory errors, and stop them before they freeze your machine☆15Sep 22, 2026Updated last month
- Native Windows vLLM: 0.27.1 Latest; 0.29.0 Python 3.14/CUDA 13.2 release (CPU TorchAudio), plus Python 3.13/CUDA 13.0 prerelease. PyTorch…☆65Oct 10, 2026Updated 3 weeks ago
- Use your OAuth subscriptions or API keys in any coding agent, Factory Droid, Cursor, and more. Tunnel Agent handles provider authenticati…☆38Nov 2, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A series of templates, tips and tricks to help solo ttrpg players.☆26Jul 17, 2025Updated last year
- vllm for pascal☆12Nov 22, 2025Updated 11 months ago
- Custom HIP inference engine for AMD MI50/MI60 (gfx906)☆19Oct 4, 2026Updated last month
- automated OCI (docker image) builds for (almost) all caddy dns plugins!☆13Oct 19, 2026Updated 2 weeks ago
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Sep 9, 2026Updated last month
- Dockerized environment to ease odoo development☆18Updated this week
- Truthful scheduler-step and streaming visualization for local LLM inference☆35Sep 6, 2026Updated 2 months ago
- Eni in lime☆23Jun 23, 2026Updated 4 months ago
- Simple ruby wrappers for LZMA compression and decompression. Fully functional, on Ruby, JRuby, and MacRuby.☆12Jun 8, 2010Updated 16 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Generic markdown vault MCP with hybrid search☆38Updated this week
- DOT pipeline for brainstorming, planning, TDD implementation, and multi-model code review on Attractor-compatible runners.☆10Mar 14, 2026Updated 7 months ago
- ChatGPT降智解决方案 | 指纹浏览器 + 美国静态住宅 IP 轻松破解 GPT 降智 | ChatGPT 降智恢复方法 | 最有效的 ChatGPT 账号降智恢复策略☆26Feb 8, 2025Updated last year
- FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with r…☆18Apr 22, 2026Updated 6 months ago
- ☆12Jul 6, 2022Updated 4 years ago
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆162Oct 26, 2026Updated last week
- Linux anonymity / OPSEC toolkit — Tor-by-default with a kill switch, leak verification, and pluggable upstreams. Authorized use only.☆24Sep 2, 2026Updated 2 months ago
- ☆23Feb 17, 2026Updated 8 months ago
- ☆27Sep 11, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Bang - #! script execution for Windows☆18Jan 22, 2023Updated 3 years ago
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆19Feb 21, 2026Updated 8 months ago
- One-menu RTX 5090 installer for fafstmobel with Cinference, DFlash2, K8V4, and vision.☆24Oct 2, 2026Updated last month
- A PowerShell module for interacting with the Ansible Semaphore API☆11Jul 27, 2026Updated 3 months ago
- Private Document Chat - 100% Client-Side AI☆39Nov 6, 2025Updated last year
- Presto docker image based on alpine☆15Nov 3, 2020Updated 6 years ago
- AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices☆19Sep 1, 2026Updated 2 months ago