ruikangliu / Quantized-Reasoning-Models
Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"
☆26Updated 2 weeks ago
Alternatives and similar repositories for Quantized-Reasoning-Models:
Users that are interested in Quantized-Reasoning-Models are comparing it to the libraries listed below
- Code implementation of GPTQv2 (https://arxiv.org/abs/2504.02692)☆29Updated last week
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆63Updated 6 months ago
- [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization☆36Updated 7 months ago
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆127Updated 2 months ago
- SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference☆46Updated 5 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆65Updated last year
- AFPQ code implementation☆20Updated last year
- ☆68Updated 3 months ago
- [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers☆47Updated 7 months ago
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆47Updated last year
- 16-fold memory access reduction with nearly no loss☆90Updated 3 weeks ago
- Implementation for the paper: CMoE: Fast Carving of Mixture-of-Experts for Efficient LLM Inference☆19Updated last month
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆35Updated last year
- LLM Inference with Microscaling Format☆20Updated 5 months ago
- Low-bit optimizers for PyTorch☆128Updated last year
- XAttention: Block Sparse Attention with Antidiagonal Scoring☆140Updated 3 weeks ago
- Are gradient information useful for pruning of LLMs?☆43Updated last year
- ☆26Updated 9 months ago
- Triton implement of bi-directional (non-causal) linear attention☆46Updated 2 months ago
- ☆20Updated 5 months ago
- Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆81Updated 5 months ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆26Updated last year
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆94Updated last week
- ☆122Updated 2 months ago
- Efficient Mixture of Experts for LLM Paper List☆62Updated 4 months ago
- Official implementation of the ICLR 2024 paper AffineQuant☆25Updated last year
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆184Updated last week
- ☆76Updated last week
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆41Updated last month
- ☆36Updated 5 months ago