Single-file, dependency-free live dashboard for local llama.cpp/vLLM serving — GPU, throughput, KV/ctx, model library. Stdlib Python + one local-first HTML page.
☆70Aug 15, 2026Updated last week
Alternatives and similar repositories for llm-serve-dashboard
Users that are interested in llm-serve-dashboard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open WebUI tool port of Superpowers by Jesse Vincent — brainstorm → spec → plan → execute agentic dev workflow for local LLMs☆63Apr 25, 2026Updated 3 months ago
- A full GUI experience on top of llama.cpp: all-knobs model tuning, one-click build/update from upstream, HuggingFace discovery with VRAM-…☆63Aug 9, 2026Updated 2 weeks ago
- Instantly understand any codebase. One command, zero API keys, works fully offline. Auto-detects 20+ project types, maps architecture, an…☆29May 20, 2026Updated 3 months ago
- Gives agents a real browser. URL in, pruned snapshot out. Replaces Playwright, Selenium, Puppeteer. Zero deps, zero wasted tokens.☆45Jul 13, 2026Updated last month
- local-first MCP discovery runtime for agents — search before invoke, reduce prompt bloat, and route to local MCP tools☆33May 10, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Jul 21, 2022Updated 4 years ago
- Layla Typescript SDK for creating custom mini-apps within Layla☆20Updated this week
- A full RAG (Retrieval Augmented Generation) system featuring a low friction GraphRAG and conversational interface on documents.☆33Apr 15, 2026Updated 4 months ago
- Layla server is a thin wrapper around llama-server (or any other server for that matter) that proxies OpenAI compatible requests through …☆15Updated this week
- Support files for my book "Learn Cisco Network Administration in a Month of Lunches" from Manning Publications☆14Aug 15, 2017Updated 9 years ago
- Use Forgejo with Coolify just like GitHub! Native integration for browsing repos, automatic webhooks, and push-to-deploy☆23Jul 16, 2025Updated last year
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆33Jun 30, 2026Updated last month
- A PowerShell script to automatically generate a script and Windows scheduled task for setting NVIDIA eGPU power limit (and any custom act…☆15Jul 29, 2020Updated 6 years ago
- 🏆Winning Project | ModelGate is a contract-aware AI control plane that ingests customer contracts, extracts SLA/privacy/routing constrai…☆51Mar 22, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Self-hosted malware static triage platform powered by LLMs☆24Updated this week
- Connect Chromium to LLM agents via token-efficient DOM compression. 50-200 tokens per page.☆21Aug 16, 2026Updated last week
- Durable, file-based long-term memory for AI agents. Five-package plugin family: SDK, CLI, MCP server, Hermes adapter, and a LangGraph Bas…☆103Updated this week
- Scripting Package for the automation of Dell Command | Update☆24Sep 10, 2024Updated last year
- Fast, secure Rust database manager☆18Jul 18, 2026Updated last month
- AV2 video decoder in Rust — full port of dav2d C logic to memory-safe Rust. 47K lines, 786 tests. Assembly DSP via FFI.☆18Updated this week
- Let your AI agent call your phone and talk to you — MCP servers for live, interruptible voice calls + tiered alerts, using free self-host…☆18Jun 23, 2026Updated 2 months ago
- ☆18Jul 16, 2026Updated last month
- A local-first web search agent☆30Jun 20, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆30Jul 15, 2026Updated last month
- Deterministic agentic-style multi-hop RAG at research-SOTA parity on commodity LLM APIs — no GPU, proof tree per answer.☆38Jul 4, 2026Updated last month
- ☆18Jul 8, 2026Updated last month
- Give your agent a real phone number and an email inbox — in minutes, not days.☆22Updated this week
- 🚀 100% local RAG system with one-command setup. Your data never leaves your server. Apache-2.0☆57Updated this week
- ML experiment tracker. Simple alternative for neptune.ai or Tensorboard.☆18Apr 11, 2026Updated 4 months ago
- ☆20Sep 28, 2024Updated last year
- Public registry for local-first wellness MCP connectors: wearables, recovery, training, nutrition and the Delx Wellness Hermes profile.☆24Updated this week
- Win & Liunux Gradio WebUI for CSM-1B model by sesame☆52Mar 17, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Open-source, self-hosted AI workspace for local and open-weight LLMs with vLLM, LiteLLM, autonomous agents, MCP tools, deep research, art…☆23Updated this week
- ☆32Aug 3, 2026Updated 3 weeks ago
- "O(log N) MoE Expert routing via RT Core ray tracing. BVH traversal replaces matrix multiplication in neural language models."☆83Apr 13, 2026Updated 4 months ago
- Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud…☆76Updated this week
- Trying to make the largest repository of deeplearnjs example code☆10Aug 19, 2019Updated 7 years ago
- pi.dev + llama.cpp ❤️☆24Jul 6, 2026Updated last month
- A VVC/H.266 screen content encoder in hardware and software.☆18Jul 9, 2026Updated last month