Single-file, dependency-free live dashboard for local llama.cpp/vLLM serving — GPU, throughput, KV/ctx, model library. Stdlib Python + one local-first HTML page.
☆75Nov 3, 2026Updated last week
Alternatives and similar repositories for llm-serve-dashboard
Users that are interested in llm-serve-dashboard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆143Oct 17, 2026Updated 3 weeks ago
- Open WebUI tool port of Superpowers by Jesse Vincent — brainstorm → spec → plan → execute agentic dev workflow for local LLMs☆64Apr 25, 2026Updated 6 months ago
- Official MCP server for Socialcrawl☆28Updated this week
- Skill that runs other Skills written as Jinja templates.☆11Oct 12, 2026Updated last month
- Chat with any local and remote LLM endpoint and track speed☆17Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Open-source Windows AI IDE built with .NET 10 WPF, featuring a fine-tuned local AI router (1.5B), live Blender & Unity copilots, self-hea…☆20Updated this week
- Gives agents a real browser. URL in, pruned snapshot out. Replaces Playwright, Selenium, Puppeteer. Zero deps, zero wasted tokens.☆46Oct 30, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆142Oct 15, 2026Updated 3 weeks ago
- Zero downtime embedding upgrades☆55Sep 15, 2026Updated last month
- ☆13Jul 21, 2022Updated 4 years ago
- This is more like a QA system☆16Jul 20, 2026Updated 3 months ago
- ☆30Apr 5, 2026Updated 7 months ago
- Instantly understand any codebase. One command, zero API keys, works fully offline. Auto-detects 20+ project types, maps architecture, an…☆30Updated this week
- A full RAG (Retrieval Augmented Generation) system featuring a low friction GraphRAG and conversational interface on documents.☆34Oct 13, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Cross-platform menu bar / tray app for Klipper printers via Moonraker. Live progress, time left, temperatures, macros, preheat presets, A…☆12Updated this week
- Speed up ComfyUI model loading on slow SSDs with adaptive sequential read-ahead for Windows.☆13Aug 30, 2026Updated 2 months ago
- Local-first, LLM-agnostic memory system — hybrid retrieval (vector + lexical + graph), multi-signal ranking. Runs on 4GB RAM, CPU-only, n…☆18Oct 8, 2026Updated last month
- SoundCraft, the open-source Rust DAW, with the Plenio add-in: AI songs and covers (YuE2) with lyrics, MIDI score, takes and stems on trac…☆16Updated this week
- local-first MCP discovery runtime for agents — search before invoke, reduce prompt bloat, and route to local MCP tools☆40May 10, 2026Updated 6 months ago
- Unlock P2P comms between consumer NVIDIA GPUs☆723Oct 26, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of …☆61Updated this week
- Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model,…☆124Nov 5, 2026Updated last week
- This repository provides a production-grade implementation of the Reinforcement Learning from Human Feedback (RLHF) pipeline. It mirrors …☆13Aug 13, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Unlock clock & power control on the AMD Radeon Pro V620 in passthrough VMs — 4-byte VBIOS pptable patch via QEMU romfile, no flash, no CU…☆20Jul 24, 2026Updated 3 months ago
- An experimental autonomous research system that conducts comprehensive, multi-hour research sessions and produces book-length reports wit…☆51Dec 7, 2025Updated 11 months ago
- ☆17Sep 6, 2026Updated 2 months ago
- Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No …☆20Updated this week
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,499Updated this week
- INT8-native vLLM fork☆28Updated this week
- ComfyUI nodes for long MiniMax H3 video: 2+ minutes at 1080p in one run, seamless long takes with Chained Context Windows (CCW), multi-sh…☆22Updated this week
- Self-hosted AI gateway with a built-in dashboard. OpenAI-compatible API, multi-tenant, sandboxed code execution, MCP integrations, file s…☆18Updated this week
- A collection of custom built ComfyUI nodes designed for film production pipelines, featuring Film Auteur LTX - an all-in-one node for wor…☆47Nov 5, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.☆95May 2, 2026Updated 6 months ago
- METIS-Core: A C++ Reinforcement Learning Framework☆16Nov 3, 2026Updated last week
- ☆47Jul 22, 2026Updated 3 months ago
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- ☆52Aug 7, 2026Updated 3 months ago
- LLM frontend for roleplay and creative writing☆159Updated this week
- Create locally. A local asset and REF2VA video studio for ComfyUI, powered by Qwen-Image 2.1, MiniMax H3 and the official Comfy SDK.☆22Nov 3, 2026Updated last week
Are these results useful?