haonan3 / AnchorContextLinks
AnchorAttention: Improved attention for LLMs long-context training
☆208Updated 6 months ago
Alternatives and similar repositories for AnchorContext
Users that are interested in AnchorContext are comparing it to the libraries listed below
Sorting:
- Large Language Models Can Self-Improve in Long-context Reasoning☆71Updated 7 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆204Updated 11 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"