TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120 t/s with 3.8x KV compression on RTX 3090.
☆37Apr 5, 2026Updated 6 months ago
Alternatives and similar repositories for llama-cpp-turboquant-gemma4
Users that are interested in llama-cpp-turboquant-gemma4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆26Jun 23, 2026Updated 3 months ago
- LLM inference in C/C++☆64May 7, 2026Updated 5 months ago
- ☆41Mar 31, 2026Updated 6 months ago
- MLX benchmark: Gemma 4 + Qwen 3.5 on Apple Silicon with TurboQuant KV cache☆22Apr 6, 2026Updated 6 months ago
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆95Sep 24, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆420Updated this week
- 一个初版cherry studio插件系统。可给Cherry studio增加自定义快捷键、界面风格、入口等。已包括快捷键切换模型+聚焦输入等便捷操作，提高效率。 | Start Cherry Studio with custom javascript plugins☆15Jan 16, 2026Updated 8 months ago
- ☆40Apr 5, 2026Updated 6 months ago
- ☆14Updated this week
- A filesystem-first library for prompt engineering, context engineering, agent control, reusable AI workflows, research methodology, and L…☆23Aug 24, 2026Updated last month
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's …☆93Aug 8, 2026Updated 2 months ago
- Modular Monoliths in Elixir☆12Mar 17, 2026Updated 6 months ago
- DeepSeek 网页 API 反代☆31Aug 2, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- TurboQuant 3-bit KV-cache quantization for llama.cpp☆54Jul 30, 2026Updated 2 months ago
- LLM inference in C/C++☆2,422Updated this week
- 开源网址导航☆13Apr 15, 2021Updated 5 years ago
- CSS3与页面布局学习总结（一）——概要、选择器、特殊性与刻度单位☆14Nov 24, 2016Updated 9 years ago
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 10 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- Bigint ID or primary key generator inspired by Twitter's Snowflake and Sonyflake.☆15Oct 29, 2021Updated 4 years ago
- phonetic similarity algorithms☆13Jun 19, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- RedisMQDemo☆11Jun 13, 2019Updated 7 years ago
- Implementations of UUID v4 and v7 as defined in the lastest RFC4122 draft. Including a highly-performant custom UUID v8 implementation.☆12May 27, 2025Updated last year
- Semrush MCP Server☆16Jun 3, 2025Updated last year
- ☆11Nov 29, 2023Updated 2 years ago
- Example microservice developed with Phoenix Framework☆13Mar 14, 2017Updated 9 years ago
- Docker container for use with Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch☆10Jan 19, 2019Updated 7 years ago
- http server to take screenshots of websites☆15Sep 13, 2012Updated 14 years ago
- This linter plugin for SublimeLinter provides an interface to gotype.☆21Updated this week
- ☆11Feb 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Halide backend for ONNX☆12Nov 5, 2019Updated 6 years ago
- ☆13Nov 18, 2025Updated 10 months ago
- ☆13Mar 13, 2023Updated 3 years ago
- 基于Winform的一套商家管理工具，用来练习界面布局，自动更新，事件，异步，多线程，网络请求，缓存使用，任务存储，设计模式，爬 虫流程，反爬虫机制等功能的一个Demo☆10Dec 8, 2022Updated 3 years ago
- .NET 跨平台微服务架构解决方案☆16Jul 10, 2026Updated 2 months ago
- authorization/permission service, inspired by Google Zanzibar☆15May 28, 2026Updated 4 months ago
- Provides safety features used by the horde.☆15Aug 25, 2026Updated last month