llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 3080.
☆57Jul 2, 2026Updated 3 months ago
Alternatives and similar repositories for llama-cpp-turboquant
Users that are interested in llama-cpp-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jul 6, 2026Updated 3 months ago
- llama.cpp的windows端gui界面☆26Sep 3, 2026Updated last month
- LLM inference in C/C++☆64May 7, 2026Updated 5 months ago
- Native Vulkan inference for giant MoE models on consumer AMD GPUs☆18Sep 22, 2026Updated last month
- ☆151Jun 13, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An MCP server for dataset generation, fine-tuning, RL, and evaluation of LLMs — directly from your coding agent.☆17Apr 21, 2026Updated 6 months ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆29Oct 10, 2026Updated 3 weeks ago
- A Pinokio installer for Ostris' ai-toolkit, The ultimate training toolkit for finetuning diffusion models. Main branch is [NVIDIA ONLY]☆14Oct 4, 2026Updated 3 weeks ago
- Age of Elements is an LPMud game library that runs on the LDMud game driver.☆11Apr 22, 2021Updated 5 years ago
- A quick and easy ComfyUI custom node for setting SDXL-friendly aspect ratios☆22Mar 28, 2025Updated last year
- My attempt to clean up the Dawn of Time MUD codebase☆11May 5, 2018Updated 8 years ago
- ☆15Feb 17, 2024Updated 2 years ago
- A system prompt against AI sycophancy, backed by 42 sources on why models tend to agree with you.☆19Sep 16, 2026Updated last month
- The SRD for the RPG Ironsworn☆12Oct 22, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆26Oct 22, 2026Updated last week
- Stable Diffusion in pure C/C++☆17Oct 18, 2026Updated last week
- 余繁细柳体，由动态组字技术生成的中文字体☆11Apr 17, 2024Updated 2 years ago
- Import your Journals from Foundry into Obsidian☆12Aug 23, 2023Updated 3 years ago
- Local AI text-to-speech with voice cloning and voice design, powered by GGML. C++17 port of OmniVoice (k2-fsa/OmniVoice). 646 languages, …☆206Oct 16, 2026Updated 2 weeks ago
- C++/ggml port of TRELLIS.2 stage-1 geometry (image -> watertight mesh)☆24Sep 7, 2026Updated last month
- ☆22Jan 11, 2023Updated 3 years ago
- ☆22Dec 18, 2023Updated 2 years ago
- This is a working Obsidian Source Reference Document (OSRD) for Ironsworn, created by Shawn Tomkin.☆16May 5, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An implementation of the gumball of Rhino in a Grasshopper add-on.☆11Jan 26, 2016Updated 10 years ago
- TISM - The Incredible State Machine. A framework in C for developing multitasking applications on the Raspberry Pi Pico (or compatible RP…☆14Sep 5, 2026Updated last month
- Retrieve human perceivable palette of colors from images leveraging color quantization☆11Aug 31, 2024Updated 2 years ago
- Spartan-7 FPGA development board.☆11Apr 19, 2022Updated 4 years ago
- Simple MCP server for uithub.com☆21Nov 5, 2025Updated 11 months ago
- A visual editor for creating SVG Animations☆12Nov 15, 2014Updated 11 years ago
- Uberdoc is a wrapper script for pandoc which provides a build system for large documents☆24Nov 22, 2013Updated 12 years ago
- Custom nodes for ComfyUI to generate empty latent space compatible with Hunyuan models for both image and video generation.☆10Dec 29, 2024Updated last year
- Jimeng AI Free 服务支持即梦超强图像与视频生成能力，包含即梦 4.0 文生图等多款模型，提供文生图、图生图、视频生成功能（官方每日赠 66 积分，可生成 66 次），零配置部署且支持多路 token。 接口与 OpenAI 完全兼容，需从即梦官网获取 sess…☆24Sep 12, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A historical record of the Discworld mudlib, and my continued efforts to poke at it.☆18Jan 21, 2021Updated 5 years ago
- ☆15Apr 28, 2025Updated last year
- Builds of https://github.com/nurupo/vlc-pause-click-plugin targeting the nightly, in-development version of VLC☆11Apr 7, 2024Updated 2 years ago
- 📦 Cerebro plugin for applications search and launch on windows and linux☆12Aug 27, 2022Updated 4 years ago
- High-Speed SD logger☆10Mar 7, 2018Updated 8 years ago
- Experimental llama.cpp fork for inference research and development☆893Updated this week
- Describe a PCB in plain words; an AI designs it with KiCad and TraceMaker, simulates it, quotes it at JLCPCB and designs a 3D-printable F…☆22Updated this week