TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120 t/s with 3.8x KV compression on RTX 3090.
☆37Apr 5, 2026Updated 7 months ago
Alternatives and similar repositories for llama-cpp-turboquant-gemma4
Users that are interested in llama-cpp-turboquant-gemma4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆65May 7, 2026Updated 6 months ago
- Native vscode extension for pi coding agent. aka pi-vscode-qcode☆17Oct 21, 2026Updated 3 weeks ago
- MLX benchmark: Gemma 4 + Qwen 3.5 on Apple Silicon with TurboQuant KV cache☆22Apr 6, 2026Updated 7 months ago
- Benchmarks, compose files, and findings for running Qwen3.6 (27B dense + 35B-A3B MoE) on 4× RTX 3090. vLLM/AWQ vs llama.cpp/GGUF, MTP spe…☆21Aug 15, 2026Updated 3 months ago
- A fast, terminal-based color picker with mouse support. Allows for color picking in RGBA, HSL, and CMYK.☆11Jun 30, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆94Sep 24, 2026Updated last month
- Unsupported SNES emulator for multicore ARM Cortex A7,A9,A15,A53 Linux platforms.☆16Aug 23, 2026Updated 2 months ago
- ☆12Dec 11, 2022Updated 3 years ago
- A recreation of lusion.co, for fun and education.☆18Jan 14, 2026Updated 10 months ago
- An easy-to-script bot written in PHP which attempts to link IRC with SQL database, allowing for integration between platforms☆10Sep 8, 2021Updated 5 years ago
- A desert strike clone, in 3d☆12Jan 8, 2015Updated 11 years ago
- gorynlich, 2d platform dungeon romp☆13Nov 8, 2021Updated 5 years ago
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- Port of Tread Marks (Battle Tank Racing) on Pandora and Linux. Status: Working☆12Feb 18, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The l4t linux kernel☆10Dec 5, 2018Updated 7 years ago
- A pacman clone for PC which works on 8088 4.77 and EGA/VGA☆11Jul 23, 2025Updated last year
- Local AI workstation: chat by voice or text, transcribe, generate images and video (with sound on Apple Silicon), benchmark and serve ope…☆26Updated this week
- nQuantGpp includes top 10 color quantization algorithms for g++ producing high quality optimized images.☆13Oct 15, 2026Updated last month
- Video plugin for Mupen64Plus v2.0, based on the Arachnoid plugin for Project64.☆20Nov 6, 2026Updated 2 weeks ago
- Terminal racing game☆10Dec 25, 2015Updated 10 years ago
- ⠙⠕⠞⠊⠋⠽ / convert bytes to braille and back again☆13May 14, 2018Updated 8 years ago
- ☆12Dec 26, 2023Updated 2 years ago
- Truly local AI agent running entirely on your hardware. Autonomous tasks, file & shell access, Telegram updates, cron jobs, and RPG progr…☆15Nov 12, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's …☆92Aug 8, 2026Updated 3 months ago
- PCSX ReARMed specifically for Switch right now. Separate repo might go away later.☆15Sep 11, 2019Updated 7 years ago
- A plugin for GIMP that aids in the authoring of tangent-space normal maps for use in per-pixel lighting applications☆14Mar 8, 2014Updated 12 years ago
- AI Sharing Buttons for WordPress Posts☆13Jun 30, 2025Updated last year
- Html Content / Article Extractor in Golang☆15Dec 31, 2014Updated 11 years ago
- GINGE Is Not Gp2x Emulator☆14Jan 16, 2016Updated 10 years ago
- ☆14Updated this week
- 百度网盘外链生成器☆26Nov 4, 2013Updated 13 years ago
- LLM inference in C/C++☆2,454Nov 13, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Yonghz's common library for his Android emulator ports☆15Oct 17, 2010Updated 16 years ago
- Nazghul is an Ultima-like game engine (2D tile graphics) with combat, magic, NPC AI, an embedded scripting language, and in-game editing.☆13Jul 9, 2013Updated 13 years ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆435Nov 10, 2026Updated last week
- Original and reverse-engineered music players☆15Jun 24, 2023Updated 3 years ago
- Qwen3.6 vLLM Toolkit — Launcher + Templates, Optimized for 2×24 GB. vLLM launcher with an optimized hybrid chat template drawing from the…☆13Aug 23, 2026Updated 2 months ago
- MacOS dragging helper☆12Mar 31, 2024Updated 2 years ago
- This repository showcases how to create image processing pipelines using GStreamer, DeepStream and other technologies.☆10Aug 15, 2026Updated 3 months ago
Are these results useful?