[ACL 2026 Main] Code for the paper "ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs"
☆33Sep 21, 2026Updated last month
Alternatives and similar repositories for ARCQuant
Users that are interested in ARCQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆32Apr 2, 2026Updated 6 months ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated last year
- ☆126Feb 26, 2026Updated 7 months ago
- [ASPLOS 2026] M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization.☆17Jan 29, 2026Updated 8 months ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆208Apr 21, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆38Jul 27, 2026Updated 2 months ago
- ☆36Dec 22, 2025Updated 10 months ago
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆229Nov 25, 2025Updated 11 months ago
- [ICML 2026]A framework to compare low-bit integer and float-point formats☆84May 6, 2026Updated 5 months ago
- [ISCA 2025] Official Implementation of "MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization"☆26Oct 30, 2025Updated 11 months ago
- vision transformer; post-training quantization; model compression; ViT☆13Sep 1, 2026Updated last month
- DuQuant++: Fine-grained Rotation Enhances Microscaling FP4 Quantization☆27Apr 24, 2026Updated 6 months ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆536Nov 26, 2024Updated last year
- (AAAI 2026) First-Order Error Matters: Accurate Compensation for Quantized Large Language Models☆17Apr 16, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- UniQL official repository (ICLR 2026)☆19Jan 27, 2026Updated 8 months ago
- ☆17May 3, 2024Updated 2 years ago
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆41May 4, 2026Updated 5 months ago
- Quartet II Official Code☆83May 1, 2026Updated 5 months ago
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆21Apr 16, 2025Updated last year
- [ICCAD 2025] Squant☆17Jul 3, 2025Updated last year
- [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.☆188Apr 24, 2026Updated 6 months ago
- [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving☆350Jul 2, 2024Updated 2 years ago
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆169Mar 21, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official PyTorch implementation of "Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming" (ICML'23)☆13Apr 13, 2026Updated 6 months ago
- ☆30Jul 22, 2024Updated 2 years ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆101Sep 4, 2024Updated 2 years ago
- Repository for paper Temporal consistency learning for video super-resolution.☆12Jul 15, 2026Updated 3 months ago
- ☆27Apr 3, 2026Updated 6 months ago
- Vllm (A high-throughput and memory-efficient inference and serving engine for LLMs)推理框架源码学习☆14Aug 15, 2025Updated last year
- The official project website of "SliderQuant: Accurate Post-Training Quantization for LLMs" (accepted to ICLR 2026).☆27Jun 15, 2026Updated 4 months ago
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆32Feb 17, 2025Updated last year
- [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".☆25Mar 16, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆53May 20, 2025Updated last year
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago
- Codebase for layer wise N:M pruning pattern assignment for LLMs☆16Aug 5, 2025Updated last year
- ☆15Apr 6, 2026Updated 6 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆121Dec 2, 2025Updated 10 months ago
- Disaggregated quantization official codebase☆31Updated this week
- MICRO 2024 Evaluation Artifact for FuseMax☆19Aug 26, 2024Updated 2 years ago