llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 3080.
☆50Jul 2, 2026Updated last month
Alternatives and similar repositories for llama-cpp-turboquant
Users that are interested in llama-cpp-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆2,332Updated this week
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆25Aug 22, 2026Updated last week
- LLM inference in C/C++☆63May 7, 2026Updated 3 months ago
- ☆155Jun 13, 2026Updated 2 months ago
- Age of Elements is an LPMud game library that runs on the LDMud game driver.☆11Apr 22, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A simple text-rpg-engine than can run in a multitude of places☆15Aug 16, 2017Updated 9 years ago
- Exports Journal Tree to Markdown☆15Jun 29, 2026Updated 2 months ago
- Magma MUD - An old-school MUD codebase derived from DIKU, Merc, Envy, and UltraEnvy☆14Apr 7, 2023Updated 3 years ago
- Community-maintained fork of the classic Python Open Interpreter. The classic/develop branch is what I use on a regular basis, and it ha…☆33Updated this week
- dead-souls 3.8.6 with fluffos 2019☆10Jul 29, 2026Updated last month
- BasedMUD is a DikuMUD/Merc/ROM/QuickMUD/BaseMUD derived MUD with MTH telnet support☆19Jul 24, 2022Updated 4 years ago
- ☆42Apr 5, 2026Updated 4 months ago
- A simple adventure game based off the popular Open Adventure game system.☆14Nov 21, 2018Updated 7 years ago
- RMUD☆15Dec 26, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simple MCP server for uithub.com☆21Nov 5, 2025Updated 9 months ago
- Calculate discrete frechet distance.☆11Feb 21, 2016Updated 10 years ago
- 一个基于asp.net core 2.x+mysql+jwt开发的webapi项目☆12Jun 22, 2020Updated 6 years ago
- Implementaion of "A Simple Approach to Recognise Geometric Shapes Interactively" by Joaquim A. Jorge and Manuel J. Fonseca.☆19Jan 7, 2023Updated 3 years ago
- See what is in the dark fully functioning in the browser.☆22Jan 29, 2024Updated 2 years ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆985Updated this week
- CamanJS filter to white balance a canvas with a RGB color or color temperature in Kelvin☆11Jul 29, 2016Updated 10 years ago
- This example app shows how to recognize mathematical expressions using the Selvy Pen SDK for Math on Android.☆10Sep 18, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 开源网址导航☆13Apr 15, 2021Updated 5 years ago
- Unofficial demo app for CogView2☆16Jul 30, 2022Updated 4 years ago
- ☆10Aug 10, 2015Updated 11 years ago
- Memo's Blog☆27Jan 21, 2026Updated 7 months ago
- CSS3与页面布局学习总结（一）——概要、选择器、特殊性与刻度单位☆14Nov 24, 2016Updated 9 years ago
- A highly efficient, isomorphic, full-featured, multilingual text search engine library, providing full-text search, fuzzy matching, phone…☆12Jul 21, 2023Updated 3 years ago
- AresMUSH online text-based game server☆36Updated this week
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 9 years ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆363Aug 6, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Node.js Multi-User Dungeon (MUD) Framework☆26Oct 17, 2024Updated last year
- Demo for JWT☆30Aug 30, 2019Updated 7 years ago
- RedisMQDemo☆11Jun 13, 2019Updated 7 years ago
- Give a flat, perspective look to your mockups and screenshots☆12Aug 26, 2014Updated 12 years ago
- RhostMUSH 5.0: This is the official main repository of RhostMUSH. Visit us at rhostdev.mushpark.com 4201☆27Updated this week
- A Python package designed to simplify the process of creating and managing function calls to OpenAI's API, as well as models using LiteLL…☆17May 25, 2025Updated last year
- A mod that allows you to add/replace existing files without repacking CRI Middleware CPKs.☆15Jun 14, 2026Updated 2 months ago