An extension utility for llama.cpp, used with 3090*2 + Strix Halo. llama.cpp的拓展小工具，自用于3090*2 + Strix Halo。
☆413Sep 7, 2026Updated last month
Alternatives and similar repositories for llama.cpp-hub
Users that are interested in llama.cpp-hub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Windows desktop control panel for local llama.cpp server☆391Jul 13, 2026Updated 3 months ago
- ☆151Jun 13, 2026Updated 4 months ago
- A lightweight llama.cpp launcher with GUI (一个拥有图形界面的 llama.cpp 轻量启动器)☆134Oct 21, 2026Updated last week
- Web GUI for audio.cpp☆42Sep 18, 2026Updated last month
- A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.☆177Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 一款基于 Tauri 的跨平台启动器/更新程序/模型管理器，适用于 llama.cpp☆22Sep 8, 2026Updated last month
- llama.cpp的windows端gui界面☆26Sep 3, 2026Updated last month
- Local LLM Inference Speed Test Tool☆247Oct 21, 2026Updated last week
- Codex Agent skills for MV storyboard direction and MiniMax H3 production orchestration.☆25Aug 11, 2026Updated 2 months ago
- ☆134Updated this week
- ComfyUI custom node for local GGUF or OpenAI-compatible API driven procedural Three.js scene generation and rendering.☆19Oct 14, 2026Updated 2 weeks ago
- 纯本地化桌面 AI 智能体平台。Go + TypeScript + C/C++ 全栈，集成多模态对话、文生图、语音识别与合成，零 Python / 零云端依赖，全部推理本地完成。☆34Updated this week
- KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.☆1,201Updated this week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆14Sep 19, 2026Updated last month
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆22Oct 13, 2026Updated 2 weeks ago
- RTX 5070 Ti Laptop 12GB 跑 Qwen3.8-27B：NInfer + KVMem、256K 逻辑上下文、RAM KV、MTP、快速缓存续接与 dsh 本地 Agent / 搜索 / 浏览器。含源码、Windows 部署及实测。☆72Updated this week
- 基于 llama.cpp 的轻量级本地 AI 模型管理器。支持 Windows 平台一键启动对话/服务器模式，具备硬件实时监控、参数记忆与多角色 Prompt 管理功能。 En: A lightweight GUI launcher for llama.cpp on Wi…☆19Mar 24, 2026Updated 7 months ago
- Comfyui改版的插件集成，免费开源使用，在此致谢开源插件原作者，末尾已附带原插件链接。☆18Aug 27, 2026Updated 2 months ago
- A lightweight C library delivering a seamless OOP, stream programming (file stream now), C++-like exception handling, and generic progra…☆12Aug 1, 2026Updated 2 months ago
- 一个调用llm写小说的软件☆63Oct 11, 2026Updated 2 weeks ago
- A dict for llm translation model.☆32Sep 6, 2024Updated 2 years ago
- audio.cpp with a full-task WebUI - pure C++ audio-model inference engine powered by ggml. TTS, ASR/STT, VAD, voice conversion, speaker di…☆411Oct 24, 2026Updated last week
- ☆504Oct 20, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Aug 7, 2026Updated 2 months ago
- 以番号为核心的本地JAV影片库管理工具。自动扫描建库、插件刮削封面与资料、内置 libmpv 播放与本地 AI 日中字幕，兼容 NFO 导入导出。支持 Windows / macOS / Linux，也可用 Docker 部署到 NAS，手机和电视用浏览器即可访问。☆38Updated this week
- Apache-2.0 开源本地 流式语音合成 SDK，支持 Qwen3-TTS、S2-Pro、VoxCPM2 和 MOSS-TTS-Nano。☆22Oct 20, 2026Updated last week
- NInfer for Windows and around 16GB VRAM: RTX 5070 Ti / 5080 / 5090, Qwen3.8-27B GSQ-RCO Q3, CUDA 13 Native engine, tray manager, model co…☆63Oct 1, 2026Updated 3 weeks ago
- use rag with model in comfyui☆72Jul 14, 2026Updated 3 months ago
- 在 8 GB 显存的显卡上跑 35B MoE（Cyber-Tiel-Coder-35B-A3B）：专家权重流式上卡、未命中专家由 CPU 池就地计算。Strata 引擎的 fork（MIT）。RTX 4080S 实测 8 GB 档 57.7–63.5 tok/s、全常驻 1…☆29Oct 10, 2026Updated 3 weeks ago
- A 198t/s and 353t/s qwen 3.8 27b inferencing engine for 2*v100 and 4*v100☆82Updated this week
- 花果山AI灵境坊：Windows 客户端发布、更新包与使用说明。☆19Updated this week
- LLM inference in C/C++☆41Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The easiest way to use MiniMax H3. One compact workflow for T2V, I2V, first/last-frame, and reference video generation, with a unified mu…☆878Updated this week
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- Ternary (2.125 bit/weight) Bonsai 2 27B on the NINFER engine — Ada sm_89, Linux. Derivative work of Neroued/ninfer; see README.☆57Oct 23, 2026Updated last week
- 工学云自动打卡☆24Jan 25, 2025Updated last year
- Windows本地bonsai模型部署启动器☆36Oct 20, 2026Updated last week
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆473Sep 22, 2026Updated last month
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆162Updated this week