🚀 First survey on Attention Sink in Transformers — 200+ papers on utilization, interpretation, and mitigation.
☆136Jun 5, 2026Updated last month
Alternatives and similar repositories for Awesome-Attention-Sink
Users that are interested in Awesome-Attention-Sink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR2026🔥Oral] SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving☆15Feb 26, 2026Updated 5 months ago
- ☆15Jan 20, 2026Updated 6 months ago
- The Github repo for our survey paper: "Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large…☆150Apr 15, 2026Updated 3 months ago
- MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory☆48May 17, 2026Updated 2 months ago
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?☆54Mar 16, 2026Updated 4 months ago
- Official Repo for DAC-RL: Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability☆16Feb 26, 2026Updated 5 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆27Jul 7, 2025Updated last year
- SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving☆71Feb 28, 2026Updated 5 months ago
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,739Jun 10, 2026Updated last month
- Official Repo for SvS: A Self-play with Variational Problem Synthesis strategy for RLVR training☆54Dec 13, 2025Updated 7 months ago
- ☆21Mar 17, 2025Updated last year
- [preprint] sparsity☆22Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆35Jan 20, 2026Updated 6 months ago
- Paper list for the paper "Authorship Attribution in the Era of Large Language Models: Problems, Methodologies, and Challenges (SIGKDD Exp…☆19May 25, 2026Updated 2 months ago
- AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. In…☆885Updated this week
- personal settings for linux tools, including zsh, vim, tmux, pip.☆11Dec 2, 2019Updated 6 years ago
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆20Jan 25, 2026Updated 6 months ago
- Replace coding puzzles with real-work simulations.☆1,906Jul 10, 2026Updated 2 weeks ago
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,868May 20, 2026Updated 2 months ago
- ☆45Jan 4, 2026Updated 6 months ago
- Stanford CoreNLP annotator implementing jMWE for detecting Multi-Word Expressions / collocations☆15Jan 6, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆103Nov 9, 2024Updated last year
- Code for the experiments and websites of the paper "Same Task, Different Circuits"☆36Jul 21, 2026Updated last week
- excel转为go结构和json（go读取excel）☆40Feb 14, 2025Updated last year
- Foundations of Medical Large Language Model Learning☆1,756May 27, 2026Updated 2 months ago
- ☆26Dec 30, 2025Updated 6 months ago
- The code for paper "LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models"☆15Mar 2, 2025Updated last year
- [NeurIPS 2025🔥]Main source code of SRPO framework.☆193Nov 25, 2025Updated 8 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,779Jun 1, 2026Updated last month
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆5,795Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 智川x-agent☆1,088Aug 19, 2025Updated 11 months ago
- ☆20Jan 7, 2026Updated 6 months ago
- 渲染页面抓取器，可获取 JS 渲染后的完整网页数据☆15Jul 9, 2026Updated 2 weeks ago
- Align Anything: Training All-modality Model with Feedback☆4,664Nov 27, 2025Updated 8 months ago
- Structured CLI: browser-backed CLI and MCP adapter for Structured Web☆16Apr 2, 2026Updated 3 months ago
- Source Code for our ICLR'26 paper☆17Feb 22, 2026Updated 5 months ago
- [ICLR'26] SinkTrack: Attention Sink based Context Anchoring for Large Language Models☆18Apr 23, 2026Updated 3 months ago