haonan3 / AnchorContextLinks
AnchorAttention: Improved attention for LLMs long-context training
☆212Updated 8 months ago
Alternatives and similar repositories for AnchorContext
Users that are interested in AnchorContext are comparing it to the libraries listed below
Sorting:
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆101Updated 2 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆125Updated 2 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆214Updated last year
- Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas☆78Updated 3 weeks ago
- ☆86Updated 8 months ago
- A Sober Look at Language Model Reasoning☆83Updated this week
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆86Updated last year
- [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?☆80Updated 8 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆229Updated 3 weeks ago
- ☆192Updated 5 months ago
- ☆96Updated 3 weeks ago
- ☆101Updated 2 weeks ago
- A repo for open research on building large reasoning models☆106Updated this week
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆180Updated 7 months ago
- Large Language Models Can Self-Improve in Long-context Reasoning☆73Updated 10 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆119Updated 6 months ago
- Long Context Extension and Generalization in LLMs☆60Updated last year
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆47Updated 2 months ago
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆129Updated last month
- [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆74Updated 3 months ago
- A brief and partial summary of RLHF algorithms.☆132Updated 7 months ago
- ☆333Updated 2 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆180Updated 3 months ago
- The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…☆83Updated 2 weeks ago
- RM-R1: Unleashing the Reasoning Potential of Reward Models☆137Updated 3 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆180Updated 5 months ago
- ☆127Updated 6 months ago
- Repo of paper "Free Process Rewards without Process Labels"☆164Updated 6 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆141Updated last year
- ☆105Updated last year