TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120 t/s with 3.8x KV compression on RTX 3090.
☆36Apr 5, 2026Updated 5 months ago
Alternatives and similar repositories for llama-cpp-turboquant-gemma4
Users that are interested in llama-cpp-turboquant-gemma4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆25Jun 23, 2026Updated 2 months ago
- LLM inference in C/C++☆64May 7, 2026Updated 4 months ago
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆96Sep 2, 2026Updated 2 weeks ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆409Sep 10, 2026Updated last week
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- MCP server to bridge Claude with local LLMs running in LM Studio☆13Mar 21, 2025Updated last year
- Protobuf messages in a bottle☆10Updated this week
- Modular Monoliths in Elixir☆12Mar 17, 2026Updated 6 months ago
- A HTTP microservice to generate TTS☆15Updated this week
- Golang Goji app container☆10Feb 11, 2015Updated 11 years ago
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- LLM inference in C/C++☆2,386Sep 7, 2026Updated last week
- MacOS dragging helper☆12Mar 31, 2024Updated 2 years ago
- Would you like to recreate GPT-2 124m in a cave with a box of scraps and a 4090 in less than two hours? LETS SPEEDRUN!☆39Nov 26, 2025Updated 9 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 9 years ago
- Bigint ID or primary key generator inspired by Twitter's Snowflake and Sonyflake.☆15Oct 29, 2021Updated 4 years ago
- phonetic similarity algorithms☆13Jun 19, 2018Updated 8 years ago
- RedisMQDemo☆11Jun 13, 2019Updated 7 years ago
- Elixir-based Event Source server-side implementation using Phoenix Pubsub☆18Nov 25, 2020Updated 5 years ago
- Implementations of UUID v4 and v7 as defined in the lastest RFC4122 draft. Including a highly-performant custom UUID v8 implementation.☆12May 27, 2025Updated last year
- Authentication via Passkey (WebAuthn/FIDO2) for Gleam☆16Dec 10, 2024Updated last year
- ☆11Nov 29, 2023Updated 2 years ago
- Docker container for use with Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch☆10Jan 19, 2019Updated 7 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- http server to take screenshots of websites☆15Sep 13, 2012Updated 14 years ago
- ☆11Feb 17, 2025Updated last year
- ☆13Nov 18, 2025Updated 10 months ago
- ☆13Mar 13, 2023Updated 3 years ago
- 基于Winform的一套商家管理工具，用来练习界面布局，自动更新，事件，异步，多线程，网络请求，缓存使用，任务存储，设计模式，爬虫流程，反爬虫机制等功能的一个Demo☆10Dec 8, 2022Updated 3 years ago
- Back-End desenvolvido com C# utilizando .NET Core + ASP.NET Core WebApi + DDD (Domain Drive Design) + SOLID + CQRS + Design Patterns☆13Sep 6, 2018Updated 8 years ago
- A library for queueing tasks in Redis☆15Mar 10, 2016Updated 10 years ago
- Potr (Po Translator) is a command line tool for translating gettext PO files.☆12Oct 22, 2023Updated 2 years ago
- Stackdriver Logging / GCP Cloud Logging handler for the go 1.21 slog package.☆11Feb 24, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- LoTCode => LoTBlog + LoTBBS + LoTShop + PawChina ......☆10Jan 25, 2017Updated 9 years ago
- Minimalistic Docker image with Mailtrain☆12Feb 13, 2019Updated 7 years ago
- Submit URLs in bulk to Google's Indexing API using Go☆13Apr 19, 2024Updated 2 years ago
- 文字自动生成视频 - 文字生成 视频的AI工具软件汇总☆14Apr 17, 2025Updated last year
- Implementation of OpenPGP Message Format as desrcibed in RFC4880☆15May 11, 2026Updated 4 months ago
- A proof of concept on creating & logging in with a passkey in ReactJS + Typescript.☆13Jan 25, 2023Updated 3 years ago
- llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 30…☆54Jul 2, 2026Updated 2 months ago