Single-file, dependency-free live dashboard for local llama.cpp/vLLM serving — GPU, throughput, KV/ctx, model library. Stdlib Python + one local-first HTML page.
☆66Jul 30, 2026Updated this week
Alternatives and similar repositories for llm-serve-dashboard
Users that are interested in llm-serve-dashboard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open WebUI tool port of Superpowers by Jesse Vincent — brainstorm → spec → plan → execute agentic dev workflow for local LLMs☆63Apr 25, 2026Updated 3 months ago
- A full GUI experience on top of llama.cpp: all-knobs model tuning, one-click build/update from upstream, HuggingFace discovery with VRAM-…☆54Updated this week
- Instantly understand any codebase. One command, zero API keys, works fully offline. Auto-detects 20+ project types, maps architecture, an…☆29May 20, 2026Updated 2 months ago
- local-first MCP discovery runtime for agents — search before invoke, reduce prompt bloat, and route to local MCP tools☆31May 10, 2026Updated 2 months ago
- This is more like a QA system☆16Jul 20, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A full RAG (Retrieval Augmented Generation) system featuring a low friction GraphRAG and conversational interface on documents.☆33Apr 15, 2026Updated 3 months ago
- this is a web scraper for stl files great for 3D printers☆16Feb 23, 2026Updated 5 months ago
- Use Forgejo with Coolify just like GitHub! Native integration for browsing repos, automatic webhooks, and push-to-deploy☆21Jul 16, 2025Updated last year
- An experimental autonomous research system that conducts comprehensive, multi-hour research sessions and produces book-length reports wit…☆48Dec 7, 2025Updated 7 months ago
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆32Jun 30, 2026Updated last month
- self-hosted maps application that requires no internet connection☆26Jun 6, 2025Updated last year
- 🏆Winning Project | ModelGate is a contract-aware AI control plane that ingests customer contracts, extracts SLA/privacy/routing constrai…☆51Mar 22, 2026Updated 4 months ago
- ☆11Apr 25, 2017Updated 9 years ago
- Local-first NotebookLM alternative powered by Nemotron. YouTube transcript, Playwright JS rendering, FTS5 RAG, DDG search, SSE streaming.☆16May 14, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Self-hosted malware static triage platform powered by LLMs☆24Jun 11, 2026Updated last month
- Durable, file-based long-term memory for AI agents. Five-package plugin family: SDK, CLI, MCP server, Hermes adapter, and a LangGraph Bas…☆98Updated this week
- Bookmarklet to pull and run hugging face GGUF models in Ollama☆18Oct 17, 2024Updated last year
- A local-first web search agent☆29Jun 20, 2026Updated last month
- Privacy focused bank and credit card statement insights and visualizer☆22Jun 22, 2026Updated last month
- Deterministic agentic-style multi-hop RAG at research-SOTA parity on commodity LLM APIs — no GPU, proof tree per answer.☆38Jul 4, 2026Updated 3 weeks ago
- 🚀 100% local RAG system with one-command setup. Your data never leaves your server. AGPL-3.0☆57Jun 23, 2026Updated last month
- Protocol-driven agent loops for shipping real code with less babysitting.☆15Apr 21, 2026Updated 3 months ago
- A solid-state, high-performance Catppuccin Macchiato theme for Omarchy Linux.☆18Jun 14, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆20Sep 28, 2024Updated last year
- Run MoE models bigger than your RAM. A 284B on a 12 GB phone, CPU only, lossless, on stock llama.cpp☆122Updated this week
- Yoga App☆21Jul 26, 2026Updated last week
- iOS camera for OBS Studio over Wi-Fi or USB — 4K60, screen mirroring, remote start, auto lip sync.☆21Jul 27, 2026Updated last week
- ☆26Updated this week
- Public registry for local-first wellness MCP connectors: wearables, recovery, training, nutrition and the Delx Wellness Hermes profile.☆22Updated this week
- Win & Liunux Gradio WebUI for CSM-1B model by sesame☆52Mar 17, 2025Updated last year
- ☆22Updated this week
- C++ template edition of the (standard) kalman filter☆10Aug 26, 2012Updated 13 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆27Updated this week
- empirically chooses -ngl param for llama.cpp☆20Mar 19, 2025Updated last year
- "O(log N) MoE Expert routing via RT Core ray tracing. BVH traversal replaces matrix multiplication in neural language models."☆83Apr 13, 2026Updated 3 months ago
- Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud…☆52Updated this week
- Trying to make the largest repository of deeplearnjs example code☆10Aug 19, 2019Updated 6 years ago
- R package that provides an implementation of the generic adaptive Monte Carlo Markov chain sampler proposed by Vihola (2011).☆10Jan 29, 2024Updated 2 years ago
- Summoned Monsters is a card game in which two players use monster cards, spells and traps to try to reduce their opponent's life points.☆11Jul 30, 2025Updated last year