llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 3080.
☆59Jul 2, 2026Updated 4 months ago
Alternatives and similar repositories for llama-cpp-turboquant
Users that are interested in llama-cpp-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MCP-powered memory, policy, and experience layer for safer AI agents.☆12May 8, 2026Updated 6 months ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆18Sep 11, 2026Updated 2 months ago
- AI全自动短视频引擎 Pixelle-Video 部署版☆16May 3, 2026Updated 6 months ago
- A quick and easy ComfyUI custom node for setting SDXL-friendly aspect ratios☆22Mar 28, 2025Updated last year
- ComfyUI client for llama-server from llama.cpp☆12Aug 5, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A modular llama.cpp integration for ComfyUI - local LLM inference nodes☆14Oct 22, 2026Updated 3 weeks ago
- 一套让 AI 做的动效视频更好看的规则,加上一套能直接跑的代码引擎。AI 写代码,逐帧画出画面、合成配乐,输出 30–60 秒的动效短片。有口播、无口播都可以。默认竖版 9:16(1080×1920),也可以横版 16:9(1920×1080)。☆23Oct 8, 2026Updated last month
- ☆15Feb 17, 2024Updated 2 years ago
- ☆25Apr 3, 2026Updated 7 months ago
- This project provide a plan of Android App Hook. It can do the hook work both in Java and NDK.☆16Aug 23, 2019Updated 7 years ago
- ☆14Oct 29, 2023Updated 3 years ago
- Convert ePUB to Obsidian or Split big md file into multiple linked notes, using metadata and resources section.☆19Sep 17, 2025Updated last year
- Stable Diffusion in pure C/C++☆18Oct 18, 2026Updated last month
- ☆11Nov 14, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- chrome extension☆18Jun 29, 2020Updated 6 years ago
- Fork of turbo quant tom-tom and TurboQuant KV cache from domwox☆32Oct 29, 2026Updated 3 weeks ago
- A web application to explore RTTI database of Cyberpunk 2077.☆10Nov 10, 2026Updated last week
- Custom nodes for ComfyUI to generate empty latent space compatible with Hunyuan models for both image and video generation.☆10Dec 29, 2024Updated last year
- ☆15Apr 28, 2025Updated last year
- 🎬 AI全自动短视频引擎 — 基于 Pixelle-Video,新增 HappyHorse (DashScope) 云端文生视频。无需GPU,输入主题一键生成完整视频。Apache 2.0。☆58May 14, 2026Updated 6 months ago
- ARM binaries for the DLI MDG-217 Camera Assembly (Originally sold alongside the Atomic Pi)☆13May 16, 2020Updated 6 years ago
- MCP server for [current] Audiobookshelf API☆11Nov 12, 2025Updated last year
- A yt-dlp TUI for Omarchy — dual-mode audio/video paste-and-queue downloader (Go + Bubble Tea)☆10Sep 3, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Sandbox for experimenting with the Ace editor☆13Feb 24, 2026Updated 8 months ago
- An Android app to store and execute shell scripts☆19Jul 30, 2022Updated 4 years ago
- Experimental llama.cpp fork for inference research and development☆910Nov 13, 2026Updated last week
- A collection of useful command line tools for PC (includes Unix tools, Ag (silver searcher), Clink, Google Code Search, and more...)☆16Feb 13, 2018Updated 8 years ago
- Automate Code-Signing and Notarization for macOS Apps, PKGs and DMGs.☆12Dec 26, 2023Updated 2 years ago
- A common protocol for AI agent tools☆10Oct 21, 2024Updated 2 years ago
- A pages lists plugin for Pico CMS, with nested pages, pages filtering and HTML navigation.☆13Mar 27, 2023Updated 3 years ago
- LLM inference in C/C++☆369Oct 30, 2026Updated 3 weeks ago
- ☆12Aug 18, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ACE-Step Music Gen VST Plugin powered by acestep.cpp☆13Mar 22, 2026Updated 7 months ago
- Modified ESP8266 Arduino core for Spacehuhn Projects☆15Aug 7, 2021Updated 5 years ago
- Introduction to RAG (Retrieve Augmented Generation)☆11Feb 1, 2024Updated 2 years ago
- ☆20Aug 18, 2025Updated last year
- Blackbox tool for setting keyboard shortcuts for manipulating windows☆10Jan 30, 2022Updated 4 years ago
- The repository contains completed scripts from CyberArk's "Automation with RestAPI" Course.☆10Apr 16, 2024Updated 2 years ago
- Provides a simpler approach to declaring and using AIDL objects for IPC on Android.☆13Aug 8, 2013Updated 13 years ago
Are these results useful?