haonan3 / AnchorContextLinks
AnchorAttention: Improved attention for LLMs long-context training
☆213Updated 11 months ago
Alternatives and similar repositories for AnchorContext
Users that are interested in AnchorContext are comparing it to the libraries listed below
Sorting:
- Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas☆93Updated 3 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆107Updated 2 months ago
- ☆85Updated last month
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆148Updated 5 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆224Updated last year
- [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆74Updated 6 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆89Updated last year
- ☆114Updated 3 months ago
- Large Language Models Can Self-Improve in Long-context Reasoning☆73Updated last year
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆210Updated 3 weeks ago
- RM-R1: Unleashing the Reasoning Potential of Reward Models☆154Updated 6 months ago
- ☆200Updated 8 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆180Updated 5 months ago
- Long Context Extension and Generalization in LLMs☆62Updated last year
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆102Updated last year
- ☆346Updated 4 months ago
- [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"☆67Updated 8 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆123Updated 8 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆188Updated 9 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆50Updated 5 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆187Updated last year
- A repo for open research on building large reasoning models☆125Updated last week
- ☆136Updated 9 months ago
- A Sober Look at Language Model Reasoning☆92Updated last month
- LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models☆78Updated last year
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆181Updated 6 months ago
- ☆140Updated 3 months ago
- ☆108Updated 3 months ago
- [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?☆82Updated 11 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆241Updated 3 months ago