Activation-aware Singular Value Decomposition for Compressing Large Language Models
☆95Oct 22, 2024Updated 2 years ago
Alternatives and similar repositories for ASVD4LLM
Users that are interested in ASVD4LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆309Aug 28, 2025Updated last year
- PyTorch code for our paper "AdaSVD: Adaptive Singular Value Decomposition for Large Language Models"☆16Mar 9, 2025Updated last year
- ☆10Dec 13, 2024Updated last year
- [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection☆167Feb 20, 2025Updated last year
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆32Feb 17, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- PyTorch implementation of Language model compression with weighted low-rank factorization☆14Jun 28, 2023Updated 3 years ago
- [NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation☆11Apr 10, 2025Updated last year
- [AAAI 2026] Official implementation of "FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models". If you find this reposi…☆19Aug 26, 2026Updated 2 months ago
- [ICML 2025] SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models☆67Aug 9, 2024Updated 2 years ago
- This repository provides the official implementation of QSVD, a method for efficient low-rank approximation that unifies Query-Key-Value …☆31May 16, 2026Updated 5 months ago
- For releasing code related to compression methods for transformers, accompanying our publications☆464Sep 10, 2026Updated last month
- ☆64Oct 17, 2023Updated 3 years ago
- [ICML 2024] Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆44Feb 4, 2025Updated last year
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆22Oct 15, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆30Jul 22, 2024Updated 2 years ago
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆228Nov 25, 2025Updated 11 months ago
- [ICLR 2025] Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"☆55Oct 19, 2025Updated last year
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- VGDFR: Diffuison-based Video Generation with Dynamic Frame Rate☆18May 16, 2025Updated last year
- ☆129Jan 22, 2024Updated 2 years ago
- Reorder-based post-training quantization for large language model☆201May 17, 2023Updated 3 years ago
- Quantization in the Jagged Loss Landscape of Vision Transformers☆14Oct 22, 2023Updated 3 years ago
- PB-LLM: Partially Binarized Large Language Models☆159Nov 20, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆136Oct 13, 2026Updated 3 weeks ago
- [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization☆40Sep 24, 2024Updated 2 years ago
- ☆15Nov 7, 2024Updated last year
- [ICLR'25] ARB-LLM: Alternating Refined Binarizations for Large Language Models☆31Aug 5, 2025Updated last year
- Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)☆97Jul 28, 2025Updated last year
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- UniQL official repository (ICLR 2026)☆19Jan 27, 2026Updated 9 months ago
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆21Apr 16, 2025Updated last year
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆440Feb 14, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Sep 7, 2024Updated 2 years ago
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆32Mar 28, 2024Updated 2 years ago
- Official code release for Delta Activations: A Representation for Finetuned Large Language Models☆22Sep 5, 2025Updated last year
- [ICCV 2025] QuEST: Efficient Finetuning for Low-bit Diffusion Models☆62Jun 26, 2025Updated last year
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆162Aug 21, 2025Updated last year
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- source code of the paper: Robust Quantization: One Model to Rule Them All☆42Mar 24, 2023Updated 3 years ago