🚀 First survey on Attention Sink in Transformers — 200+ papers on utilization, interpretation, and mitigation.
☆143Jun 5, 2026Updated 4 months ago
Alternatives and similar repositories for Awesome-Attention-Sink
Users that are interested in Awesome-Attention-Sink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR2026🔥Oral] SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving☆15Feb 26, 2026Updated 7 months ago
- ☆15Jan 20, 2026Updated 8 months ago
- The Github repo for our survey paper: "Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large…☆160Apr 15, 2026Updated 5 months ago
- MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory☆55May 17, 2026Updated 4 months ago
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?☆55Mar 16, 2026Updated 6 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆27Jul 7, 2025Updated last year
- SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving☆78Feb 28, 2026Updated 7 months ago
- Official Repo for DAC-RL: Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability☆41Sep 20, 2026Updated 2 weeks ago
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,782Aug 18, 2026Updated last month
- Official Repo for SvS: A Self-play with Variational Problem Synthesis strategy for RLVR training☆86Sep 25, 2026Updated 2 weeks ago
- ☆20Mar 17, 2025Updated last year
- [NeurIPS'26] In this work, we investigate how Large Language Models (LLMs) adapt their internal representations when encountering inputs …☆29Sep 24, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆36Jan 20, 2026Updated 8 months ago
- Paper list for the paper "Authorship Attribution in the Era of Large Language Models: Problems, Methodologies, and Challenges (SIGKDD Exp…☆20May 25, 2026Updated 4 months ago
- AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. In…☆890Updated this week
- personal settings for linux tools, including zsh, vim, tmux, pip.☆11Dec 2, 2019Updated 6 years ago
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆24Jan 25, 2026Updated 8 months ago
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,951May 20, 2026Updated 4 months ago
- ☆46Jan 4, 2026Updated 9 months ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆103Nov 9, 2024Updated last year
- Code for the experiments and websites of the paper "Same Task, Different Circuits"☆37Jul 21, 2026Updated 2 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- excel转为go结构和json（go读取excel）☆40Feb 14, 2025Updated last year
- Foundations of Medical Large Language Model Learning☆2,130May 27, 2026Updated 4 months ago
- ☆27Dec 30, 2025Updated 9 months ago
- The code for paper "LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models"☆17Mar 2, 2025Updated last year
- [NeurIPS 2025🔥]Main source code of SRPO framework.☆193Nov 25, 2025Updated 10 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,807Jun 1, 2026Updated 4 months ago
- 智川x-agent☆1,090Aug 19, 2025Updated last year
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆5,900Updated this week
- 渲染页面抓取器，可获取 JS 渲染后的完整网页数据☆15Jul 9, 2026Updated 3 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆30Jan 7, 2026Updated 9 months ago
- Align Anything: Training All-modality Model with Feedback☆4,666Nov 27, 2025Updated 10 months ago
- Structured CLI: browser-backed CLI and MCP adapter for Structured Web☆16Apr 2, 2026Updated 6 months ago
- Source Code for our ICLR'26 paper☆18Feb 22, 2026Updated 7 months ago
- Stanford CoreNLP annotator implementing jMWE for detecting Multi-Word Expressions / collocations☆15Jan 6, 2017Updated 9 years ago
- [ICLR'26] SinkTrack: Attention Sink based Context Anchoring for Large Language Models☆19Apr 23, 2026Updated 5 months ago
- Predicting high-fitness mutations based on protein inverse folding models☆1,145Sep 30, 2025Updated last year