TurboQuant 3-bit KV-cache quantization for llama.cpp
☆55Jul 30, 2026Updated 3 months ago
Alternatives and similar repositories for llama-turboquant
Users that are interested in llama-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于MNN和cpp-httplib实现的简单llm推理服务☆10Apr 9, 2024Updated 2 years ago
- [AMD ONLY] Super Optimized Gradio UI for AI video creation for GPU poor machines (6GB+ VRAM). Supports Wan 2.1/2.2, Qwen, Hunyuan Video, …☆19Oct 10, 2026Updated last month
- ☆25Feb 10, 2026Updated 9 months ago
- Recording models☆13Sep 19, 2023Updated 3 years ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- BDD (Behavior Driven Development / Specification Driven Development) tool for Dart and Flutter. Create your BDD tests purely in code, and…☆17Oct 30, 2026Updated last week
- ☆41Mar 31, 2026Updated 7 months ago
- the colorful sidepanel tab extension☆10Jul 22, 2026Updated 3 months ago
- ☆25Nov 5, 2022Updated 4 years ago
- ☆18Mar 10, 2026Updated 8 months ago
- Standalone async Sentinel-2 COG tile server.☆11Apr 2, 2026Updated 7 months ago
- ☆14Apr 1, 2026Updated 7 months ago
- ☆12Dec 1, 2025Updated 11 months ago
- LLM inference in C/C++☆2,448Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Store your Limitless life log in a GitHub repository☆10Oct 21, 2026Updated 3 weeks ago
- Terraform provider for WorkOS - manage organizations, SSO connections, directory sync, webhooks, users, and AuthKit resources☆15Oct 27, 2026Updated 2 weeks ago
- Self-hosted test suite for local LLMs — deterministic, agentic (real curl tool-calls), and blinded-subjective evals. React/Vite/TS + Fast…☆12Jul 1, 2026Updated 4 months ago
- Proxmox GPU Passthrough Guide for AMD Ryzen AI Max+ 395 (Strix Halo / 8060S)☆54Sep 12, 2025Updated last year
- Legal Research Assistant streamlines legal research with LangChain, Neo4j, and Google Generative AI. It aids legal professionals in case …☆11Feb 3, 2025Updated last year
- A ROS 1/ROS 2 hybrid package wrapping the Apache TVM project.☆10Jan 24, 2023Updated 3 years ago
- ☆13Nov 22, 2022Updated 3 years ago
- AI runtime optimized for agentic work with Qwen models on AMD RX 7900 XT/XTX☆24Updated this week
- Text-audio foundation model from Boson AI☆12Jul 28, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Creating AI agents with the simplicity of Python in Java.☆14Mar 21, 2026Updated 7 months ago
- Windows API binding for Golang generator☆16Apr 9, 2023Updated 3 years ago
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 5 years ago
- Access an iPhone backup as a disk on Windows and Linux☆12Jul 10, 2023Updated 3 years ago
- ☆12Oct 1, 2023Updated 3 years ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- ☆11Aug 31, 2026Updated 2 months ago
- Local-first, LLM-guided, coverage-driven fuzzer for network protocols and binary formats. Single Rust binary. Zero signup.☆15Jul 14, 2026Updated 3 months ago
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆225Oct 25, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,059Apr 23, 2026Updated 6 months ago
- Local LLM Server Manager + LlaMA.cpp + Chat☆140Nov 2, 2026Updated last week
- Save on tokens and time for bolt.new workflows☆12Jun 12, 2025Updated last year
- Installation script for an AI applications using ROCm on Linux.☆51Oct 9, 2026Updated last month
- minimal C implementation of speculative decoding based on llama2.c☆30Jul 15, 2024Updated 2 years ago
- ☆10Jul 28, 2021Updated 5 years ago
Are these results useful?