TurboQuant 3-bit KV-cache quantization for llama.cpp
☆55Jul 30, 2026Updated 2 months ago
Alternatives and similar repositories for llama-turboquant
Users that are interested in llama-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Generate images locally with Bonsai 1-bit and ternary image generation models.☆30Jun 12, 2026Updated 3 months ago
- Recording models☆13Sep 19, 2023Updated 3 years ago
- ☆25Feb 10, 2026Updated 7 months ago
- convert pytorch model to ncnn☆13Dec 5, 2018Updated 7 years ago
- ☆41Mar 31, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A collection of container images used in CI across various opencontainers projects☆18Mar 22, 2023Updated 3 years ago
- Simulation, multi-path estimation, and CBR parsing code of SIGCOMM2023 BeamSense CBR-Sensing☆10Jan 14, 2024Updated 2 years ago
- ☆20Jul 21, 2026Updated 2 months ago
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆25Apr 1, 2025Updated last year
- ☆17Mar 10, 2026Updated 6 months ago
- Proxmox GPU Passthrough Guide for AMD Ryzen AI Max+ 395 (Strix Halo / 8060S)☆52Sep 12, 2025Updated last year
- A high-performance RCCL / NCCL (ROCm Communication Collectives Library) plugin for Thunderbolt 5 that enables GPU-to-GPU communication ac…☆70Sep 16, 2026Updated 2 weeks ago
- Minimalist ML framework for Rust☆22Aug 15, 2026Updated last month
- LLM inference in C/C++☆2,414Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆13Jul 21, 2023Updated 3 years ago
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 4 years ago
- Open Doodles☆13Jan 4, 2023Updated 3 years ago
- LTX-2 is the first DiT-based audio-video foundation model that contains all core capabilities of modern video generation in one model: sy…☆31Sep 9, 2026Updated 3 weeks ago
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,052Apr 23, 2026Updated 5 months ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆14Mar 5, 2025Updated last year
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- ☆13Sep 13, 2023Updated 3 years ago
- A step-by-step guide to setting up llama.cpp with ROCm on AMD APUs☆23Jan 2, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆21Jul 19, 2024Updated 2 years ago
- Installation script for an AI applications using ROCm on Linux.☆50Sep 5, 2026Updated 3 weeks ago
- ☆19Apr 14, 2025Updated last year
- 使用ONNXRuntime部署一种用于边缘检测的轻量级密集卷积神经网络LDC，包含C++和Python两个版本的程序☆12Apr 24, 2023Updated 3 years ago
- Write data migration logic in code so you can change the shape of your data confidently as your app evolves☆15Sep 29, 2023Updated 3 years ago
- ☆87Updated this week
- 机器学习实战：一、用朴素贝叶斯分类器推测11篇存在争议的《联邦党人文集》的作者 二、使用KNN、SVM、逻辑回归、K-Means方法对高斯分布分类 三、实现协同滤波算法进行电影推荐系统☆14Feb 1, 2023Updated 3 years ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 3 years ago
- Identify dead links in Firefox and Chrome bookmark files.☆17Nov 15, 2020Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Docker image for WhisperX by Max Bain☆13Sep 24, 2025Updated last year
- With a few words and a click of a button, quickly get an engaging, high quality video. (And optionally save and share it!)☆18May 4, 2025Updated last year
- ComfyUI custom node for automatic background removal and transparency generation. Integrates TransparencyBackgroundRemover into ComfyUI w…☆22Apr 24, 2026Updated 5 months ago
- [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning☆16Sep 20, 2025Updated last year
- ⚡ Sao chép Google Drive siêu tốc 🚀 Xử lý đa luồng giúp tăng tốc độ sao chép dữ liệu 🔄 Tự động khôi phục và tiếp tục công việc khi gặp …☆21Jul 20, 2026Updated 2 months ago
- nack keyboard☆11Mar 15, 2024Updated 2 years ago
- Fork of RecurrentGPT with modifications☆10Sep 18, 2024Updated 2 years ago