Alternatives and similar repositories for Attention-Sink:

Users that are interested in Attention-Sink are comparing it to the libraries listed below

• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆41Updated 2 weeks ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆37Updated 10 months ago
• Joshua-Ren / Learning_dynamics_LLM
  ☆76Updated last week
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆58Updated last month
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆67Updated 2 months ago
• ShadeCloak / ADORA
  ☆43Updated 3 weeks ago
• AlexanderVNikitin / kernel-language-entropy
  Code for Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities (NeurIPS'24)
  ☆21Updated 4 months ago
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆34Updated 3 weeks ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆93Updated last month
• activatedgeek / calibration-tuning
  ☆52Updated 3 weeks ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 6 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆95Updated last month
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆54Updated last month
• OpenSparseLLMs / MoM
  ☆77Updated 2 weeks ago
• uservan / ThinkPO
  ☆20Updated 2 months ago
• princeton-pli / what-makes-good-rm
  What Makes a Reward Model a Good Teacher? An Optimization Perspective
  ☆26Updated 3 weeks ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆67Updated 2 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 8 months ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆56Updated last month
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆58Updated 2 months ago
• HKUNLP / diffusion-of-thoughts
  [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"
  ☆147Updated 2 months ago
• limenlp / verl
  AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
  ☆29Updated 3 weeks ago
• Lingkai-Kong / RE-Control
  Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective
  ☆29Updated 3 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 3 weeks ago
• sail-sg / ActivePRM
  ☆15Updated 2 weeks ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆58Updated 4 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆136Updated last month
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 11 months ago
• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆45Updated 5 months ago
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆83Updated 5 months ago