TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120 t/s with 3.8x KV compression on RTX 3090.
☆36Apr 5, 2026Updated 4 months ago
Alternatives and similar repositories for llama-cpp-turboquant-gemma4
Users that are interested in llama-cpp-turboquant-gemma4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆41Mar 31, 2026Updated 4 months ago
- Fused TBQ4 Flash Attention + MTP + Shared Tensors + Qwen35 SWA Hybrid for llama.cpp — 82+ tok/s, lossless 4.25 bpv KV cache, SWA-bounded …☆92Updated this week
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆362Aug 6, 2026Updated 3 weeks ago
- Generate a snapshot of owners with quantity for any erc721/erc1155, on any chain.☆10Jan 24, 2023Updated 3 years ago
- AutoMapper website☆14Aug 19, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- ☆18Feb 10, 2020Updated 6 years ago
- MCP server to bridge Claude with local LLMs running in LM Studio☆13Mar 21, 2025Updated last year
- Rust implementation of POST proving☆13Dec 15, 2025Updated 8 months ago
- TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's …☆91Aug 8, 2026Updated 3 weeks ago
- Create a blockchain in pure python and basic cryptographic primitives.☆10Apr 12, 2021Updated 5 years ago
- This is a golang facial recognition project based on the go-face library.☆14Mar 22, 2024Updated 2 years ago
- Dynex has also developed a proprietary circuit design, the Dynex Neuromorphic Chip, that complements the Dynex ecosystem and turns any mo…☆15May 26, 2023Updated 3 years ago
- Golang Goji app container☆10Feb 11, 2015Updated 11 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- LLM inference in C/C++☆2,328Updated this week
- 开源网址导航☆13Apr 15, 2021Updated 5 years ago
- ☆10Aug 10, 2015Updated 11 years ago
- Rust Shaicoin Miner☆10Dec 27, 2025Updated 8 months ago
- A simple application to calculate similarity between two files (text document) using Smith-Waterman algorithm that is used originally to …☆10Apr 15, 2017Updated 9 years ago
- A non-custodial Kaspa wallet app for iOS and Android☆12Sep 23, 2025Updated 11 months ago
- MacOS dragging helper☆12Mar 31, 2024Updated 2 years ago
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 9 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A python repo for reading and analyzing the Kaspa full-node DB☆11Nov 5, 2024Updated last year
- ☆13Feb 28, 2024Updated 2 years ago
- Autonomys monitoring powershell script for Windows and Linux☆12May 5, 2025Updated last year
- RedisMQDemo☆11Jun 13, 2019Updated 7 years ago
- ☆17May 8, 2025Updated last year
- http server to take screenshots of websites☆15Sep 13, 2012Updated 13 years ago
- This linter plugin for SublimeLinter provides an interface to gotype.☆21Apr 24, 2025Updated last year
- ☆11Feb 17, 2025Updated last year
- Mobile Wallet for Vite blockchain☆17Mar 7, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Mar 2, 2026Updated 5 months ago
- A Halide backend for ONNX☆12Nov 5, 2019Updated 6 years ago
- go routine pool☆11Apr 23, 2020Updated 6 years ago
- A gRPC-Web implementation for Python☆14Jan 28, 2025Updated last year
- ☆13Mar 13, 2023Updated 3 years ago
- 收录全球 AI 产品 ，每小时更新排名。☆10Mar 18, 2025Updated last year
- ASP.NET Core WebApi EntityFrameworkCore 连接mysql 、sqlserver的样例工程☆10Jan 4, 2017Updated 9 years ago