Open-source PyTorch implementation of Google TurboQuant (ICLR 2026) — extreme KV-cache quantization to ~3 bits with zero accuracy loss. 6x less memory, up to 8x faster inference.
☆42Mar 26, 2026Updated 5 months ago
Alternatives and similar repositories for turboquant-kv
Users that are interested in turboquant-kv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of Paper "System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving"☆30Apr 17, 2026Updated 5 months ago
- Apply data augmentation techniques on YOLO v7 format dataset.☆18Nov 20, 2023Updated 2 years ago
- Implementation of EWC introduced by "Overcoming catastrophic forgetting in neural networks"☆16Jun 9, 2017Updated 9 years ago
- Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design☆26May 29, 2025Updated last year
- Implementation of Latent Replay, a Continual Learning strategy for Real-Time / On The Edge applications☆14May 7, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Advancing the frontier of efficient AI☆69Sep 16, 2026Updated last week
- Export Blender (2.4x) curves to TikZ format for use with TeX☆13Apr 18, 2014Updated 12 years ago
- This repository implements continuous test-time adaptation algorithms for object detection on the SHIFT dataset.☆30Jul 5, 2024Updated 2 years ago
- ☆24Aug 18, 2021Updated 5 years ago
- An Android app built entirely with C and raylib☆15Updated this week
- From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% a…☆1,046Apr 23, 2026Updated 4 months ago
- Load your graph of bookmarks and tags into a neo4j database and explore it☆14Jan 1, 2017Updated 9 years ago
- frame interpolation for CLIP guided videos☆15Aug 18, 2022Updated 4 years ago
- 🐝 Tiny CLI to post simultaneously to Mastodon and Bluesky☆17Apr 3, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SparCL: Sparse Continual Learning on the Edge @ NeurIPS 22☆31May 29, 2023Updated 3 years ago
- Voronoi Diagram implementation☆10Aug 3, 2019Updated 7 years ago
- If you like this program (Voicemeeter), please support the creator with a purchase. This method should only be used for those who cannot …☆11Aug 2, 2022Updated 4 years ago
- ComfyUI sampler for HyperSDXL UNet☆11Jun 20, 2024Updated 2 years ago
- Chrome extension to enable and disable other extensions quickly☆14Oct 14, 2022Updated 3 years ago
- Mirror of https://git.ffmpeg.org/ffmpeg.git☆10Sep 5, 2026Updated 2 weeks ago
- Procedural Nodes helps you adding procedural Materials with one click.☆14Aug 23, 2022Updated 4 years ago
- Ability to quickly group tabs by their attributes☆16Jan 17, 2026Updated 8 months ago
- ☆19Dec 31, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Html interface for GLPK.js solver☆17Aug 11, 2020Updated 6 years ago
- RayCast simple engine for 3d game☆14Dec 27, 2025Updated 8 months ago
- The GNU MathProg implementation of OSeMOSYS☆12Nov 7, 2024Updated last year
- Drop-in convolutional Kolmogorov-Arnold Network☆20May 23, 2024Updated 2 years ago
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆27Updated this week
- Collection of useful configs, scripts and tweaks for Microsoft Windows VMs☆12Jul 31, 2026Updated last month
- A collection of user scripts that I made to make my experience on the web a little nicer☆19May 25, 2024Updated 2 years ago
- Home Page☆18Oct 4, 2025Updated 11 months ago
- pytorch实现的Pyramidbox 人脸检测模型， 对原来代码的部分模块进行了修改，更简洁高效☆22Dec 8, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- WordPress Preview Revisions Plugin help editors to preview the revisions with exact same content that would look like on the frontend.☆11Aug 13, 2026Updated last month
- ☆69Dec 3, 2024Updated last year
- Command line keyboard heatmap generator.☆20Oct 3, 2023Updated 2 years ago
- ☆22Jul 13, 2026Updated 2 months ago
- Official Repository for Task-Circuit Quantization☆28Jun 1, 2025Updated last year
- fingerpose-gestures is a library built on top of Fingerpose classifier for hand landmarks detected by TensorFlow.js' handpose model. It c…☆16May 2, 2023Updated 3 years ago
- Script that generates palettes by text description via stable diffusion.☆27Nov 1, 2022Updated 3 years ago