TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120 t/s with 3.8x KV compression on RTX 3090.
☆35Apr 5, 2026Updated 3 months ago
Alternatives and similar repositories for llama-cpp-turboquant-gemma4
Users that are interested in llama-cpp-turboquant-gemma4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆21Jun 23, 2026Updated 3 weeks ago
- Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090☆89May 17, 2026Updated 2 months ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆306Updated this week
- AutoMapper website☆14Aug 19, 2020Updated 5 years ago
- MCP server to bridge Claude with local LLMs running in LM Studio☆13Mar 21, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Protobuf messages in a bottle☆10Feb 14, 2025Updated last year
- Html Content / Article Extractor in Golang☆15Dec 31, 2014Updated 11 years ago
- 一个基于asp.net core 2.x+mysql+jwt开发的webapi项目☆12Jun 22, 2020Updated 6 years ago
- TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's …☆91Jul 12, 2026Updated last week
- This is a golang facial recognition project based on the go-face library.☆14Mar 22, 2024Updated 2 years ago
- A HTTP microservice to generate TTS☆15May 5, 2026Updated 2 months ago
- DeepSeek 网页 API 反代☆19May 3, 2026Updated 2 months ago
- LLM inference in C/C++☆2,152Updated this week
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 开源网址导航☆13Apr 15, 2021Updated 5 years ago
- ☆10Aug 10, 2015Updated 10 years ago
- A simple application to calculate similarity between two files (text document) using Smith-Waterman algorithm that is used originally to …☆10Apr 15, 2017Updated 9 years ago
- MacOS dragging helper☆12Mar 31, 2024Updated 2 years ago
- Would you like to recreate GPT-2 124m in a cave with a box of scraps and a 4090 in less than two hours? LETS SPEEDRUN!☆38Nov 26, 2025Updated 7 months ago
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 9 years ago
- Bigint ID or primary key generator inspired by Twitter's Snowflake and Sonyflake.☆15Oct 29, 2021Updated 4 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- phonetic similarity algorithms☆13Jun 19, 2018Updated 8 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Elixir-based Event Source server-side implementation using Phoenix Pubsub☆18Nov 25, 2020Updated 5 years ago
- Authentication via Passkey (WebAuthn/FIDO2) for Gleam☆16Dec 10, 2024Updated last year
- Semrush MCP Server☆15Jun 3, 2025Updated last year
- ☆20May 30, 2025Updated last year
- ☆17May 8, 2025Updated last year
- Flexible goroutine orchestrator 🚀☆12Dec 15, 2025Updated 7 months ago
- This linter plugin for SublimeLinter provides an interface to gotype.☆21Apr 24, 2025Updated last year
- ☆11Feb 17, 2025Updated last year
- A Halide backend for ONNX☆12Nov 5, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- .NET 跨平台微服务架构解决方案☆16Jul 10, 2026Updated last week
- ASP.NET Core WebApi EntityFrameworkCore 连接mysql 、sqlserver的样例工程☆11Jan 4, 2017Updated 9 years ago
- Provides safety features used by the horde.☆14Jul 22, 2025Updated 11 months ago
- Back-End desenvolvido com C# utilizando .NET Core + ASP.NET Core WebApi + DDD (Domain Drive Design) + SOLID + CQRS + Design Patterns☆12Sep 6, 2018Updated 7 years ago
- 基于vue的练手项目☆11Dec 11, 2022Updated 3 years ago
- scripts for deploying Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled☆17Mar 31, 2026Updated 3 months ago
- Stackdriver Logging / GCP Cloud Logging handler for the go 1.21 slog package.☆10Feb 24, 2025Updated last year