haonan3 / AnchorContextLinks
AnchorAttention: Improved attention for LLMs long-context training
☆212Updated 6 months ago
Alternatives and similar repositories for AnchorContext
Users that are interested in AnchorContext are comparing it to the libraries listed below
Sorting:
- [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆71Updated last month
- Large Language Models Can Self-Improve in Long-context Reasoning☆72Updated 8 months ago
- A repo for open research on building large reasoning models☆84Updated this week
- ☆117Updated 4 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆86Updated 10 months ago
- ☆322Updated last week
- A Sober Look at Language Model Reasoning☆81Updated last month
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆172Updated 5 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆103Updated 3 weeks ago
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆171Updated last week
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆105Updated 3 months ago
- A brief and partial summary of RLHF algorithms.☆131Updated 5 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆169Updated 3 weeks ago
- Code for "Reasoning to Learn from Latent Thoughts"☆114Updated 4 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆205Updated last year
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆92Updated last week
- General Reasoner: Advancing LLM Reasoning Across All Domains☆156Updated last month
- ☆81Updated last week
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆253Updated 2 months ago
- Revisiting Mid-training in the Era of Reinforcement Learning Scaling☆161Updated 2 weeks ago
- Repo for "Z1: Efficient Test-time Scaling with Code"☆63Updated 3 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆139Updated 10 months ago
- The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆160Updated last month
- ☆83Updated 6 months ago
- Repo of paper "Free Process Rewards without Process Labels"☆160Updated 4 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆43Updated 3 weeks ago
- Function Vectors in Large Language Models (ICLR 2024)☆175Updated 3 months ago
- ☆126Updated 2 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆173Updated last year
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆218Updated 5 months ago