HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE speculative decoding, and full Wave32 kernel optimizations.
β24Jun 23, 2026Updated 2 months ago
Alternatives and similar repositories for llama.cpp-1-bit-turbo
Users that are interested in llama.cpp-1-bit-turbo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pure PyTorch implementation of HISA (Hierarchical Indexed Sparse Attention) as a drop-in plugin for HuggingFace modelsβ16Apr 7, 2026Updated 4 months ago
- π π π¨π«π€ π¨π ππ‘π’πππ π¨ππ π¦πππ ππ¨ π₯π¨π¨π€ π₯π’π€π ππ’π§ππ¨π°π¬ ππππ.β19Jun 18, 2026Updated 2 months ago
- 1bit llama.cpp gguf weights paired with turboquant 4 bit kv cacheβ23Apr 4, 2026Updated 4 months ago
- TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads β lazy K/V, batch decode, warp-cooperative write. 120β¦β36Apr 5, 2026Updated 4 months ago
- The fastest inference framework to run AI on CPUsβ19Jun 12, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Production-grade Go backend using Gin, GORM, Redis, and Swagger with clean architecture and fintech-ready infrastructure.β17Jan 14, 2026Updated 7 months ago
- β16Jun 14, 2026Updated 2 months ago
- LLM inference in C/C++β63May 7, 2026Updated 3 months ago
- Orquestr Pro - AI Assistant Desktop Appβ17Mar 5, 2026Updated 5 months ago
- Modular task agnostic training pipeline using LFM2 from Liquid AI with unsloth.β16Sep 13, 2025Updated 11 months ago
- β41Mar 31, 2026Updated 4 months ago
- TurboQuant reference implementation β KV cache compression with engineering insights (ICLR 2026 paper reproduction)β17Mar 28, 2026Updated 4 months ago
- Config files for my GitHub profile.β12Updated this week
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.β14Oct 7, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Protobuf messages in a bottleβ10Feb 14, 2025Updated last year
- β18Nov 1, 2024Updated last year
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cppβ33Aug 17, 2026Updated last week
- β19Updated this week
- The first browser MCP built for security testing. Give your AI agent a real Firefox browser and let it find vulnerabilities.β19Mar 14, 2026Updated 5 months ago
- β16Jan 18, 2025Updated last year
- β16Jun 24, 2025Updated last year
- β16Nov 3, 2023Updated 2 years ago
- β19Feb 9, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- β19Dec 16, 2024Updated last year
- β14May 2, 2026Updated 3 months ago
- Lossless compression using Probabilistic Circuitsβ16Mar 10, 2022Updated 4 years ago
- For salami (Oneplus 11)β17Jun 10, 2026Updated 2 months ago
- Bigint ID or primary key generator inspired by Twitter's Snowflake and Sonyflake.β15Oct 29, 2021Updated 4 years ago
- phonetic similarity algorithmsβ13Jun 19, 2018Updated 8 years ago
- aospa device tree for realme 5 series (r5x)β17Aug 11, 2026Updated last week
- β16Oct 27, 2024Updated last year
- β17Nov 29, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available β’ AdRun AI, ML, and HPC workloads on powerful cloud GPUsβwithout limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Common tree for oplus SM6375 devicesβ17Mar 17, 2025Updated last year
- Android 14 Device Tree for Realme X (RMX1901) - RUI 2.0 Firmware Baseβ17Dec 24, 2024Updated last year
- β15Apr 14, 2026Updated 4 months ago
- β13Apr 11, 2022Updated 4 years ago
- Payments platform project focused on production operations: tenant-safe APIs, idempotent money flows, transactional outbox for async procβ¦β15Jul 28, 2026Updated 3 weeks ago
- β19Oct 22, 2024Updated last year
- Let's Startβ20Updated this week