Fork of turbo quant tom-tom and TurboQuant KV cache from domwox
☆30Jul 7, 2026Updated 3 weeks ago
Alternatives and similar repositories for llama.cpp-turboquant-hip
Users that are interested in llama.cpp-turboquant-hip are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆22Jun 23, 2026Updated last month
- RDNA-native LLM inference engine in Rust.☆496Updated this week
- Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon☆19Apr 20, 2026Updated 3 months ago
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 3 months ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆65Jul 10, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM inference in C/C++☆124Updated this week
- Native Excel (.xlsx) generator tool for Open WebUI — multi-sheet, Tables, live formulas, charts. MIT.☆19Jul 19, 2026Updated 2 weeks ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆422Jul 25, 2026Updated last week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆829Updated this week
- this is a web scraper for stl files great for 3D printers☆16Feb 23, 2026Updated 5 months ago
- ProCurrency Official Source Code☆13May 9, 2019Updated 7 years ago
- ☆13Mar 20, 2018Updated 8 years ago
- 2D Character Creator Example☆11Dec 2, 2019Updated 6 years ago
- ☆55Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆636Updated this week
- NEW ROCmfp4 format for llama.cpp☆139Jun 13, 2026Updated last month
- llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 30…☆41Jul 2, 2026Updated last month
- ☆10Feb 11, 2022Updated 4 years ago
- ☆25Jul 3, 2026Updated last month
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆50May 10, 2026Updated 2 months ago
- Blockchain learning network☆21Oct 30, 2017Updated 8 years ago
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆17Jul 23, 2026Updated last week
- open-source container runtime for quilt.sh☆16Feb 25, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A global voice dictation tool for Linux using local OpenAI Whisper. Fast, accurate, and works on Wayland/X11.☆19May 25, 2026Updated 2 months ago
- ☆11Jun 21, 2023Updated 3 years ago
- Jailbreak Evaluation Module☆27Jul 21, 2026Updated last week
- Agent Skills Open Standard skill for Holochain hApp development, compatible with Claude Code, GitHub Copilot, Cursor, Augment, and any o…☆15May 16, 2026Updated 2 months ago
- ☆18Jun 11, 2018Updated 8 years ago
- Catches silent CPU fallback and mislabeled tok/s in local LLMs. llama.cpp and ollama, one file, no deps.☆17Jul 16, 2026Updated 2 weeks ago
- Curated AMD GPU compatibility index and CLI for AI workloads☆31May 23, 2026Updated 2 months ago
- ☆18Jun 21, 2019Updated 7 years ago
- News application built using Expo Router, React Native, and NewsAPI☆12Mar 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆25Updated this week
- High-Resolution Differential Z-Belt Mod for V0 (with optional Kirigami support)☆12May 22, 2022Updated 4 years ago
- Automatically remove old form entries on a custom, defined schedule☆18Aug 1, 2023Updated 3 years ago
- One place to talk to all your agents☆19May 1, 2026Updated 3 months ago
- Timeseries app for COVID-19 tracking☆16Aug 10, 2020Updated 5 years ago
- Pure shell + tmux + git event driven multi-harness orchestrator☆19May 21, 2026Updated 2 months ago
- ☆10Jan 22, 2023Updated 3 years ago