Alternatives and similar repositories for SQuat

Users that are interested in SQuat are comparing it to the libraries listed below

• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆32Updated 3 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 7 months ago
• RobertCsordas / moeut
  ☆79Updated 10 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 9 months ago
• katiekang1998 / reasoning_generalization
  ☆32Updated 5 months ago
• complex-reasoning / RPG
  The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆35Updated this week
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆33Updated 3 months ago
• OpenMOSS / Lorsa
  ☆20Updated last week
• SalesforceAIResearch / Elastic-Reasoning
  Make reasoning models scalable
  ☆37Updated 3 weeks ago
• zqOuO / GWT
  ☆13Updated 5 months ago
• Infini-AI-Lab / S2FT
  ☆17Updated 5 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆69Updated 2 weeks ago
• BaohaoLiao / RSD
  [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆32Updated last month
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆105Updated 2 months ago
• model-similarity / lm-similarity
  ☆18Updated 4 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆52Updated 3 months ago
• scitix / MEAP
  Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
  ☆31Updated last month
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆45Updated 3 months ago
• hkust-nlp / PreSelect
  [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches
  ☆49Updated 3 months ago
• ChengpengLi1003 / CoRT
  ☆40Updated this week
• SalesforceAIResearch / GemFilter
  ☆80Updated 5 months ago
• Multiverse4FM / Multiverse
  ☆45Updated last week
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆42Updated last year
• JacobPfau / fillerTokens
  ☆65Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆50Updated 3 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• dayal-kalra / low-memory-adam
  ☆12Updated 3 months ago
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆69Updated this week
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆71Updated 8 months ago
• Infini-AI-Lab / Multiverse
  ☆58Updated this week