Code repository for ICLR 2025 paper "LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid"
☆29Mar 2, 2025Updated last year
Alternatives and similar repositories for LeanQuant
Users that are interested in LeanQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (AAAI 2026) First-Order Error Matters: Accurate Compensation for Quantized Large Language Models☆17Apr 16, 2026Updated 3 months ago
- ☆19Feb 4, 2025Updated last year
- ☆15Apr 6, 2026Updated 4 months ago
- [CVPRW 2026 Oral] Less Detail, Better Answers: Degradation-Driven Prompting for VQA☆20Apr 25, 2026Updated 3 months ago
- [IJCAI 2023] CLE-ViT: Contrastive Learning Encoded Transformer for Ultra-Fine-Grained Visual Categorization.☆11Nov 3, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆24Sep 16, 2022Updated 3 years ago
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆224Nov 25, 2025Updated 8 months ago
- DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference☆653Nov 24, 2025Updated 8 months ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆29Apr 2, 2026Updated 4 months ago
- Arrow Matrix Decomposition - Communication-Efficient Distributed Sparse Matrix Multiplication☆15Mar 25, 2024Updated 2 years ago
- PyTorch implementation of Language model compression with weighted low-rank factorization☆14Jun 28, 2023Updated 3 years ago
- A tool which checks compatibility of CoreML model with Apple Neural Engine☆15May 30, 2022Updated 4 years ago
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆95Apr 8, 2025Updated last year
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆422Feb 14, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Jun 9, 2017Updated 9 years ago
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆31Feb 17, 2025Updated last year
- Piecewise-Affine Regularized Quantization☆19Feb 5, 2026Updated 6 months ago
- Training project about Deep Learing☆12Jun 22, 2017Updated 9 years ago
- ☆21Feb 5, 2024Updated 2 years ago
- ☆14May 21, 2024Updated 2 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation ICML_2023☆13Oct 27, 2023Updated 2 years ago
- ☆11May 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An Alfred workflow to toggle Yosemite's dark and light modes.☆14Oct 6, 2018Updated 7 years ago
- ☆16Nov 28, 2023Updated 2 years ago
- ☆16May 27, 2026Updated 2 months ago
- ☆14Jun 9, 2017Updated 9 years ago
- Code for paper "Conversational Product Search Based on Negative Feedback"☆12Jun 26, 2020Updated 6 years ago
- Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)☆93Jul 28, 2025Updated last year
- ☆13Jan 7, 2025Updated last year
- [CVPR 2025] APHQ-ViT: Post-Training Quantization with Average Perturbation Hessian Based Reconstruction for Vision Transformers☆44Apr 7, 2025Updated last year
- ☆14Jan 10, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- PyTorch Implementation of Weakly Supervised Pre-training - [IJCAI19]☆12May 23, 2020Updated 6 years ago
- ☆10Jun 16, 2022Updated 4 years ago
- [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric☆61Mar 23, 2023Updated 3 years ago
- -A library which does oversampling to allow you to read with a resolution of 10-bit to 21-bit on the Arduino ADC (Analog to Digital Conve…☆17Dec 29, 2016Updated 9 years ago
- [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.☆140May 16, 2024Updated 2 years ago
- Official implementation for "K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling"☆18Jun 14, 2026Updated last month
- Benchmark datasets for sentiment analysis☆14May 18, 2020Updated 6 years ago