This repo contains the code for studying the interplay between quantization and sparsity methods
☆26Feb 26, 2025Updated last year
Alternatives and similar repositories for quantization-sparsity-interplay
Users that are interested in quantization-sparsity-interplay are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dynamical low rank training for neural networks☆11Aug 24, 2023Updated 3 years ago
- [NeurIPS 2024] AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models☆35Jun 9, 2025Updated last year
- ☆13Oct 30, 2024Updated 2 years ago
- [ICCV-2023] EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization☆29Dec 6, 2023Updated 2 years ago
- verilog实现systolic array及配套IO☆15Dec 2, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆34Jul 4, 2024Updated 2 years ago
- ☆29Dec 2, 2024Updated last year
- The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…☆50Oct 5, 2022Updated 4 years ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆543Nov 26, 2024Updated last year
- ☆34Mar 28, 2025Updated last year
- ☆20Mar 21, 2023Updated 3 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆26Dec 20, 2024Updated last year
- Efficient Knowledge Injection in LLMs via Self-Distillation (TMLR)☆13Aug 5, 2025Updated last year
- ☆26Jul 23, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆35May 24, 2024Updated 2 years ago
- ☆13Feb 24, 2021Updated 5 years ago
- [ICCV] CODE-CL: Conceptor-Based Gradient Projection for Deep Continual Learning☆12Dec 12, 2025Updated 11 months ago
- The official implementation of the ICML 2023 paper OFQ-ViT☆39Oct 3, 2023Updated 3 years ago
- [ICLR2026] The first W4A4KV4 quantized + 50% sparse LLMs!☆35Jan 26, 2026Updated 9 months ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆30Jul 24, 2025Updated last year
- Official PyTorch implementation of "Evolving Search Space for Neural Architecture Search"☆12Aug 18, 2021Updated 5 years ago
- Code for RepNAS☆14Dec 21, 2021Updated 4 years ago
- [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.☆142May 16, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆62Jun 10, 2024Updated 2 years ago
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆230Nov 25, 2025Updated 11 months ago
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆52Oct 21, 2023Updated 3 years ago
- ViTALiTy (HPCA'23) Code Repository☆25Mar 13, 2023Updated 3 years ago
- Are gradient information useful for pruning of LLMs?☆48Aug 23, 2025Updated last year
- A general framework for optimizing DNN dataflow on systolic array☆40Jan 2, 2021Updated 5 years ago
- gem5学习仓库,基于官方教程的汉化精简版,并修正了官方教程中部分代码存在的一些小问题。gem5官方仓库:https://github.com/gem5/gem5☆13Sep 1, 2025Updated last year
- Official implementation for ECCV 2022 paper LIMPQ - "Mixed-Precision Neural Network Quantization via Learned Layer-wise Importance"☆63Mar 19, 2023Updated 3 years ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official test catalog and test plan for Jammertest☆16Updated this week
- BESA is a differentiable weight pruning technique for large language models.☆17Mar 4, 2024Updated 2 years ago
- ☆30Jul 22, 2024Updated 2 years ago
- LEO extension of the open-source 5G NR NTN testbed: full satellite pass with live propagation delay and Doppler tracking, 600 km orbit. C…☆16Oct 24, 2026Updated 3 weeks ago
- T-Basis: a Compact Representation for Neural Networks☆10Jul 13, 2021Updated 5 years ago
- ☆10Dec 13, 2024Updated last year
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 3 years ago
Are these results useful?