☆151Jun 13, 2026Updated 4 months ago
Alternatives and similar repositories for llama.cpp-MTP-TurboQuant
Users that are interested in llama.cpp-MTP-TurboQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆95Sep 24, 2026Updated last month
- An extension utility for llama.cpp, used with 3090*2 + Strix Halo. llama.cpp的拓展小工具，自用于3090*2 + Strix Halo。☆413Sep 7, 2026Updated last month
- A lightweight llama.cpp launcher with GUI (一个拥有图形界面的 llama.cpp 轻量启动器)☆134Oct 21, 2026Updated last week
- Windows desktop control panel for local llama.cpp server☆391Jul 13, 2026Updated 3 months ago
- LLM inference in C/C++☆2,439Oct 22, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Benchmarks, compose files, and findings for running Qwen3.6 (27B dense + 35B-A3B MoE) on 4× RTX 3090. vLLM/AWQ vs llama.cpp/GGUF, MTP spe…☆21Aug 15, 2026Updated 2 months ago
- llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 30…☆57Jul 2, 2026Updated 3 months ago
- ComfyUI nodes for Strata: text, structured prompts, vision and managed local inference with GPU handoff. Publisher: t8star.☆19Oct 17, 2026Updated 2 weeks ago
- vLLM 0.32 fork for consumer GPUs: 3 x 262K sessions on 4x RTX 3090, Qwen 3.8 Flash-Next at 184 tok/s, up to 17 on bigger cards. Seven che…☆31Oct 22, 2026Updated last week
- Local AI workstation — discover, run, chat, benchmark, and generate images from open-weight models. DFlash/DDTree speculative decoding, T…☆25Oct 22, 2026Updated last week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,177Updated this week
- ComfyUI MiniMax H3 全家桶：Unified to Video / Context IR / Multimodal Chat / Audio Lock / Media Loader / Resolution Selector / Concat AV 等 8 …☆42Oct 20, 2026Updated last week
- The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-reques…☆1,190Oct 1, 2026Updated 3 weeks ago
- Dockerized inference server and benchmarks for quantized Gemma 4 family on the NVIDIA DGX Spark (GB10). Features ARM64 CUDA 13 builds usi…☆13Jun 20, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Experimental llama.cpp fork for inference research and development☆893Updated this week
- A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.☆177Updated this week
- ComfyUI custom node for local GGUF or OpenAI-compatible API driven procedural Three.js scene generation and rendering.☆19Oct 14, 2026Updated 2 weeks ago
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- A high-performance memory system for AI applications with advanced RAG capabilities, vector-graph hybrid storage, and adaptive learning. …☆10Jul 28, 2025Updated last year
- LLM inference in C/C++☆64May 7, 2026Updated 5 months ago
- A browser panel for the chores around ComfyUI: models with Civitai covers, trigger words and base models; Model Check finds missing model…☆147Updated this week
- Native vLLM and ROCm 7.x runtime acceleration for AMD Radeon RX 6000 Series (RDNA2) on Windows 11.☆22Aug 25, 2026Updated 2 months ago
- Help users quickly build professional cinematic prompts for Wan2.2.☆36Aug 6, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆15Jan 11, 2026Updated 9 months ago
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆162Updated this week
- ☆23Mar 31, 2026Updated 6 months ago
- A precision hardware monitor for ComfyUI. Born for Intel Arc (XPU), now supporting NVIDIA (CUDA) with AMD (ROCm) in development. Featur…☆40Sep 22, 2026Updated last month
- Comfyui改版的插件集成，免费开源使用，在此致谢开源插件原作者，末尾已附带原插件链接。☆18Aug 27, 2026Updated 2 months ago
- Open-source llama.cpp GUI for Windows — multi-GPU, TurboQuant, headless mode☆40Sep 22, 2026Updated last month
- DeepSeek V4.1 Flash 1017 MXFP4 on one RTX PRO 5000 72GB: 512K shared KV, 2 concurrent requests, DSpark and compiled lkqmoe 0.5.4.☆16Oct 24, 2026Updated last week
- 将小说剧本话工具☆36Nov 3, 2025Updated 11 months ago
- Practical AI with PyTorch 2024☆34Jan 5, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 我的AI Agents配置，包括commands，skills等☆17Updated this week
- fastllm是后端无依赖的高性能大模型推理库，帮助您在大部分设备上高效推理大模型！☆5,129Updated this week
- ☆12Aug 2, 2026Updated 2 months ago
- ComfyUI custom node for optimizing MiniMax H3 video generation prompts based on the H3 model manual☆30Updated this week
- ☆77Jul 18, 2026Updated 3 months ago
- 绕过网络限制，一键安装 Claude Desktop 并修复 Host Claude Code binary not available 问题。☆96Aug 24, 2026Updated 2 months ago
- 🪟 为 Windows AI 开发者提供预编译 wheel 文件的集中仓库 | 自动抓取并整理 PyTorch、Flash Attention、xformers、SageAttention 等常用库的最新版本 | 免编译，开箱即用 | 特别适合 ComfyUI 和 Sta…☆85Updated this week