🚀 First survey on Attention Sink in Transformers — 200+ papers on utilization, interpretation, and mitigation.
☆141Jun 5, 2026Updated 3 months ago
Alternatives and similar repositories for Awesome-Attention-Sink
Users that are interested in Awesome-Attention-Sink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR2026🔥Oral] SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving☆15Feb 26, 2026Updated 6 months ago
- ☆15Jan 20, 2026Updated 7 months ago
- The Github repo for our survey paper: "Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large…☆154Apr 15, 2026Updated 4 months ago
- MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory☆53May 17, 2026Updated 3 months ago
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?☆55Mar 16, 2026Updated 5 months ago
- Official Repo for DAC-RL: Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability☆16Feb 26, 2026Updated 6 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆27Jul 7, 2025Updated last year
- SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving☆74Feb 28, 2026Updated 6 months ago
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,767Aug 18, 2026Updated 3 weeks ago
- Official Repo for SvS: A Self-play with Variational Problem Synthesis strategy for RLVR training☆57Dec 13, 2025Updated 8 months ago
- ☆20Mar 17, 2025Updated last year
- [preprint] sparsity☆23Jul 26, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆36Jan 20, 2026Updated 7 months ago
- Paper list for the paper "Authorship Attribution in the Era of Large Language Models: Problems, Methodologies, and Challenges (SIGKDD Exp…☆20May 25, 2026Updated 3 months ago
- AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. In…☆886Updated this week
- personal settings for linux tools, including zsh, vim, tmux, pip.☆11Dec 2, 2019Updated 6 years ago
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆24Jan 25, 2026Updated 7 months ago
- Replace coding puzzles with real-work simulations.☆1,906Aug 26, 2026Updated last week
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,935May 20, 2026Updated 3 months ago
- ☆46Jan 4, 2026Updated 8 months ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆103Nov 9, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for the experiments and websites of the paper "Same Task, Different Circuits"☆37Jul 21, 2026Updated last month
- excel转为go结构和json（go读取excel）☆40Feb 14, 2025Updated last year
- Foundations of Medical Large Language Model Learning☆2,128May 27, 2026Updated 3 months ago
- The code for paper "LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models"☆15Mar 2, 2025Updated last year
- [NeurIPS 2025🔥]Main source code of SRPO framework.☆193Nov 25, 2025Updated 9 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,799Jun 1, 2026Updated 3 months ago
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆5,854Updated this week
- 智川x-agent☆1,088Aug 19, 2025Updated last year
- ☆26Jan 7, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 渲染页面抓取器，可获取 JS 渲染后的完整网页数据☆15Jul 9, 2026Updated last month
- Align Anything: Training All-modality Model with Feedback☆4,671Nov 27, 2025Updated 9 months ago
- Source Code for our ICLR'26 paper☆17Feb 22, 2026Updated 6 months ago
- Stanford CoreNLP annotator implementing jMWE for detecting Multi-Word Expressions / collocations☆15Jan 6, 2017Updated 9 years ago
- [ICLR'26] SinkTrack: Attention Sink based Context Anchoring for Large Language Models☆18Apr 23, 2026Updated 4 months ago
- Predicting high-fitness mutations based on protein inverse folding models☆1,143Sep 30, 2025Updated 11 months ago
- https://hcv.boyuai.com☆1,172Dec 18, 2024Updated last year