TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120 t/s with 3.8x KV compression on RTX 3090.
☆35Apr 5, 2026Updated 4 months ago
Alternatives and similar repositories for llama-cpp-turboquant-gemma4
Users that are interested in llama-cpp-turboquant-gemma4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆23Jun 23, 2026Updated last month
- LLM inference in C/C++☆64May 7, 2026Updated 3 months ago
- MLX benchmark: Gemma 4 + Qwen 3.5 on Apple Silicon with TurboQuant KV cache☆21Apr 6, 2026Updated 4 months ago
- Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090☆91Aug 3, 2026Updated last week
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆336Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 一个初版cherry studio插件系统。可给Cherry studio增加自定义快捷键、界面风格、入口等。已包括快捷键切换模型+聚焦输入等便捷操作，提高效率。 | Start Cherry Studio with custom javascript plugins☆15Jan 16, 2026Updated 6 months ago
- AutoMapper website☆14Aug 19, 2020Updated 5 years ago
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- MCP server to bridge Claude with local LLMs running in LM Studio☆13Mar 21, 2025Updated last year
- 一个基于asp.net core 2.x+mysql+jwt开发的webapi项目☆12Jun 22, 2020Updated 6 years ago
- Modular Monoliths in Elixir☆12Mar 17, 2026Updated 4 months ago
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- LLM inference in C/C++☆2,247Updated this week
- 百度网盘外链生成器☆26Nov 4, 2013Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 开源网址导航☆13Apr 15, 2021Updated 5 years ago
- CSS3与页面布局学习总结（一）——概要、选择器、特殊性与刻度单位☆14Nov 24, 2016Updated 9 years ago
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 9 years ago
- Bigint ID or primary key generator inspired by Twitter's Snowflake and Sonyflake.☆15Oct 29, 2021Updated 4 years ago
- RedisMQDemo☆11Jun 13, 2019Updated 7 years ago
- Elixir-based Event Source server-side implementation using Phoenix Pubsub☆18Nov 25, 2020Updated 5 years ago
- Implementations of UUID v4 and v7 as defined in the lastest RFC4122 draft. Including a highly-performant custom UUID v8 implementation.☆12May 27, 2025Updated last year
- Authentication via Passkey (WebAuthn/FIDO2) for Gleam☆16Dec 10, 2024Updated last year
- ☆13Apr 11, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Nov 29, 2023Updated 2 years ago
- Example microservice developed with Phoenix Framework☆13Mar 14, 2017Updated 9 years ago
- ☆17May 8, 2025Updated last year
- go routine pool☆11Apr 23, 2020Updated 6 years ago
- ☆13Nov 18, 2025Updated 8 months ago
- A gRPC-Web implementation for Python☆14Jan 28, 2025Updated last year
- ☆13Mar 13, 2023Updated 3 years ago
- 基于Winform的一套商家管理工具，用来练习界面布局，自动更新，事件，异步，多线程，网络请求，缓存使用，任务存储，设计模式，爬虫流程，反爬虫机制等功能的一个Demo☆10Dec 8, 2022Updated 3 years ago
- .NET 跨平台微服务架构解决方案☆16Jul 10, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ASP.NET Core WebApi EntityFrameworkCore 连 接mysql 、sqlserver的样例工程☆10Jan 4, 2017Updated 9 years ago
- authorization/permission service, inspired by Google Zanzibar☆15May 28, 2026Updated 2 months ago
- Elixir Websocket - Kitchen Sink Not Included☆18Jun 16, 2024Updated 2 years ago
- Back-End desenvolvido com C# utilizando .NET Core + ASP.NET Core WebApi + DDD (Domain Drive Design) + SOLID + CQRS + Design Patterns☆13Sep 6, 2018Updated 7 years ago
- A minimalistic ASP.NET 4.5.1/MVC 5/EF 6/Bootstrap 3.1.1 based content management system☆10Sep 21, 2015Updated 10 years ago
- A library for queueing tasks in Redis☆15Mar 10, 2016Updated 10 years ago
- Stackdriver Logging / GCP Cloud Logging handler for the go 1.21 slog package.☆10Feb 24, 2025Updated last year