TurboQuant 3-bit KV-cache quantization for llama.cpp
☆54Mar 26, 2026Updated 4 months ago
Alternatives and similar repositories for llama-turboquant
Users that are interested in llama-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆404Updated this week
- convert pytorch model to ncnn☆13Dec 5, 2018Updated 7 years ago
- Python trading bot for cryptocurrency that uses Heikin-Ashi candlesticks to make signals.☆13Apr 20, 2020Updated 6 years ago
- ☆40Mar 31, 2026Updated 3 months ago
- Ryze Tello Drone C# .net core Sdk wrapper☆29Apr 19, 2018Updated 8 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A collection of container images used in CI across various opencontainers projects☆18Mar 22, 2023Updated 3 years ago
- ☆16Updated this week
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆25Apr 1, 2025Updated last year
- ☆15Mar 10, 2026Updated 4 months ago
- LTtx是一个分布式数据中心，基于Python语言开发，为分布式服务架构提供基础的通信服务。☆10Sep 7, 2024Updated last year
- Proxmox GPU Passthrough Guide for AMD Ryzen AI Max+ 395 (Strix Halo / 8060S)☆44Sep 12, 2025Updated 10 months ago
- Detecting RSI Divergence on TradingView charts using Pinescript.☆16Jan 9, 2019Updated 7 years ago
- Converts WebAssembly to pure Go code.☆15Aug 31, 2022Updated 3 years ago
- Golang POSIX 1e ACL bindings☆14Mar 26, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- TDengine Demo Series - Consume Messages from Kafka☆10Jul 16, 2021Updated 5 years ago
- Minimalist ML framework for Rust☆22Feb 28, 2026Updated 4 months ago
- yaml version of https://github.com/hboutemy/mcmm☆13Updated this week
- LLM inference in C/C++☆2,175Updated this week
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆25Sep 1, 2025Updated 10 months ago
- Access an iPhone backup as a disk on Windows and Linux☆12Jul 10, 2023Updated 3 years ago
- BigQuant模块：advanced_auto_labeler https://bigquant.com/☆17Sep 25, 2017Updated 8 years ago
- A template for using Leptos ssr + server functions in a Cloudflare worker☆19Nov 2, 2024Updated last year
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,040Apr 23, 2026Updated 3 months ago
- PDFReporter Studio is an open source, eclipse-based report designer based on JasperSoft Studio using the PDFReporter library. Create very…☆11Feb 25, 2015Updated 11 years ago
- Allwinner XR819 Linux support☆13Jan 6, 2017Updated 9 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆14Mar 5, 2025Updated last year
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- WebRsync☆16Mar 20, 2017Updated 9 years ago
- CUDA driver API in pure Go, no cgo: loads libcuda at runtime, embeds PTX, JIT-compiles through the driver☆16Updated this week
- Find random, interesting content from Reddit and Hacker News with just one click.☆14Sep 8, 2024Updated last year
- Resilient headless browser automation on AWS Lambda using pure-Python Playwright, Docker, and Browserbase.☆15Apr 30, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Simple Biot Savart Solver in Python☆11Feb 15, 2021Updated 5 years ago
- minimal C implementation of speculative decoding based on llama2.c☆30Jul 15, 2024Updated 2 years ago
- ☆54Updated this week
- Write data migration logic in code so you can change the shape of your data confidently as your app evolves☆15Sep 29, 2023Updated 2 years ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 3 years ago
- Identify dead links in Firefox and Chrome bookmark files.☆17Nov 15, 2020Updated 5 years ago
- Docker image for WhisperX by Max Bain☆13Sep 24, 2025Updated 10 months ago