Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"
☆21Jun 11, 2025Updated 8 months ago
Alternatives and similar repositories for rsq
Users that are interested in rsq are comparing it to the libraries listed below
Sorting:
- ☆16Feb 22, 2025Updated last year
- ☆33Mar 28, 2025Updated 11 months ago
- Aligntune : A Modular Toolkit for Post Training Alignment of LLMs☆35Feb 26, 2026Updated last week
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆210Nov 25, 2025Updated 3 months ago
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"☆22Nov 9, 2025Updated 3 months ago
- ☆28May 3, 2023Updated 2 years ago
- ☆25Oct 31, 2024Updated last year
- Official Repo for Fast-SAM3D: 3Dfy Anything in Images but Faster☆97Feb 19, 2026Updated 2 weeks ago
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆24Jun 26, 2024Updated last year
- RENT (Reinforcement Learning via Entropy Minimization) is an unsupervised method for training reasoning LLMs.☆41Oct 31, 2025Updated 4 months ago
- ☆24Jul 24, 2023Updated 2 years ago
- AFPQ code implementation☆23Nov 6, 2023Updated 2 years ago
- ☆23Sep 19, 2024Updated last year
- Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)☆83Jul 28, 2025Updated 7 months ago
- ☆32Nov 11, 2024Updated last year
- Official Code Release for "Training a Generally Curious Agent"☆45May 18, 2025Updated 9 months ago
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆88Apr 8, 2025Updated 10 months ago
- Make reasoning models scalable☆47May 31, 2025Updated 9 months ago
- Bayesian Optimization Excutable and Visualizable Application☆10Aug 14, 2023Updated 2 years ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆42Dec 29, 2025Updated 2 months ago
- [ICLR 2026] RPG: KL-Regularized Policy Gradient (https://arxiv.org/abs/2505.17508)☆64Feb 19, 2026Updated 2 weeks ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆88Sep 12, 2025Updated 5 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆100Oct 15, 2025Updated 4 months ago
- ☆95Dec 19, 2025Updated 2 months ago
- Martingale posterior neural networks for fast sequential decision making @ Neurips 2025☆23Nov 13, 2025Updated 3 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆40Feb 5, 2024Updated 2 years ago
- (EMNLP 2025 Main) RACCooN: A Versatile Instructional Video Editing Framework with Auto-Generated Narratives☆37Dec 20, 2025Updated 2 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Jun 13, 2024Updated last year
- Generalised UDRL☆37May 12, 2022Updated 3 years ago
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆172Nov 26, 2025Updated 3 months ago
- rabitq rust implementation☆10Feb 4, 2026Updated last month
- GrFormer: A Novel Transformer on Grassmann Manifold for Infrared and Visible Image Fusion☆16Dec 14, 2025Updated 2 months ago
- Integrating neurosymbolic representations into LLMs for interpretability, steering, and running symbolic algorithms☆14Feb 2, 2026Updated last month
- Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity☆22Aug 28, 2025Updated 6 months ago
- Explains the conclusions of a logic program.☆10May 25, 2023Updated 2 years ago
- TSDG: An efficient index graph for graph-based nearest neighbor search☆10Jul 14, 2022Updated 3 years ago
- [ACL 2025] Knowledge Unlearning for Large Language Models☆48Sep 18, 2025Updated 5 months ago
- source code of the paper: Robust Quantization: One Model to Rule Them All☆41Mar 24, 2023Updated 2 years ago