This repository provides the official implementation of QSVD, a method for efficient low-rank approximation that unifies Query-Key-Value (QKV) weight compression in low-precision Vision-Language Models (VLMs).
☆31May 16, 2026Updated 5 months ago
Alternatives and similar repositories for QSVD
Users that are interested in QSVD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025] Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"☆55Oct 19, 2025Updated last year
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"☆99Mar 17, 2025Updated last year
- ☆10May 4, 2022Updated 4 years ago
- [AAAI 2026] Official implementation of "FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models". If you find this reposi…☆19Aug 26, 2026Updated 2 months ago
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆309Aug 28, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACM MM2025]: MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization☆45Aug 13, 2025Updated last year
- [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection☆167Feb 20, 2025Updated last year
- Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)☆97Jul 28, 2025Updated last year
- This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentia…☆29Feb 21, 2024Updated 2 years ago
- ☆11Jul 15, 2026Updated 3 months ago
- ☆19Sep 24, 2026Updated last month
- Implementation for VPBench proposed in paper Visually Prompted Benchmarks Are Surprisingly Fragile☆11Jan 14, 2026Updated 9 months ago
- [ICML 2026]A framework to compare low-bit integer and float-point formats☆84May 6, 2026Updated 5 months ago
- Research in compressing convolutional layers of CNN using low-rank Tucker tensor decomposition☆12Nov 1, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Major project - kannada LLM for farmers☆12May 20, 2024Updated 2 years ago
- Lean formalizations for the paper "ABC implies that Ramanujan's Tau function misses almost all primes"☆12Sep 11, 2026Updated last month
- Implementation of Peter Shirley's Ray Tracing In One Weekend book using Vulkan and NVIDIA's RTX extension.☆13Nov 24, 2023Updated 2 years ago
- [NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation☆11Apr 10, 2025Updated last year
- Code for: Algorithm-hardware co-design of neuromorphic networks with dual memory pathways☆17Sep 18, 2026Updated last month
- Training-free inference acceleration framework for interactive video world models, with tested support for HY-WorldPlay and Matrix-Game-3…☆23Jun 18, 2026Updated 4 months ago
- Standalone software tool for conducting spatial audio listening tests.☆16Nov 29, 2021Updated 4 years ago
- [ICRA 2025] Fast Global Localization on Neural Radiance Field☆17Jun 30, 2025Updated last year
- iEDA water-drop training initiative☆14Sep 10, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"☆24Mar 25, 2026Updated 7 months ago
- GOMIL: Global Optimization of Multiplier by Integer Linear Programming☆13Aug 25, 2021Updated 5 years ago
- ☆33Feb 6, 2026Updated 8 months ago
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆228Nov 25, 2025Updated 11 months ago
- In this tutorial, you learn how to implement a design from RTL-to-GDSII using Synopsys tools.☆16Jun 28, 2025Updated last year
- SGLang fork to reproduce the official Mirai Labs DFlash-TfM results☆24Oct 14, 2026Updated 2 weeks ago
- ACM MM 2022 《Continual Multi-view Clustering》☆10Jan 31, 2026Updated 9 months ago
- 6 DoF Directional Room Impulse Response (RIR) with Dense Loudspeaker Grid☆17Aug 31, 2023Updated 3 years ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆34Feb 26, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Implementation and evaluation of the RL algorithm Rainbow to learn to play Atari games.☆10Aug 19, 2020Updated 6 years ago
- ☆13Aug 17, 2020Updated 6 years ago
- [ICLR 2026] M2-Miner: Multi-Agent Enhanced MCTS for Mobile GUI Agent Data Mining☆55Apr 22, 2026Updated 6 months ago
- PyTorch code for our paper "AdaSVD: Adaptive Singular Value Decomposition for Large Language Models"☆16Mar 9, 2025Updated last year
- ☆14Nov 18, 2025Updated 11 months ago
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆41Dec 24, 2025Updated 10 months ago
- Here are some implementations of basic hardware units in RTL language (verilog for now), which can be used for area/power evaluation and …☆16Aug 25, 2023Updated 3 years ago