🚀 First survey on Attention Sink in Transformers — 200+ papers on utilization, interpretation, and mitigation.
☆145Oct 28, 2026Updated 3 weeks ago
Alternatives and similar repositories for Awesome-Attention-Sink
Users that are interested in Awesome-Attention-Sink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR2026🔥Oral] SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving☆15Feb 26, 2026Updated 8 months ago
- [EMNLP 2025 Oral] 🎉 Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMs☆15Dec 10, 2025Updated 11 months ago
- The Github repo for our survey paper: "Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large…☆163Apr 15, 2026Updated 7 months ago
- ☆15Jan 20, 2026Updated 9 months ago
- The official repository for PTQTP implementation☆11Sep 24, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 10 months ago
- MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory☆57May 17, 2026Updated 6 months ago
- Official code for paper "Revisiting Model Interpolation for Efficient Reasoning"☆18Jul 14, 2026Updated 4 months ago
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆25Jan 25, 2026Updated 9 months ago
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?☆55Mar 16, 2026Updated 8 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆27Jul 7, 2025Updated last year
- ☆13Jan 17, 2026Updated 10 months ago
- SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving☆80Feb 28, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,808Aug 18, 2026Updated 3 months ago
- ☆20Mar 17, 2025Updated last year
- Foundations of Medical Large Language Model Learning☆2,133May 27, 2026Updated 5 months ago
- AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. In…☆898Updated this week
- ☆36Jan 20, 2026Updated 9 months ago
- 🔥minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,矿池抽水,矿池中转,矿场运维专用☆3,702Jul 15, 2026Updated 4 months ago
- The first open autoregressive foundational video AI model.☆2,893Oct 7, 2026Updated last month
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,953May 20, 2026Updated 5 months ago
- [NeurIPS'26] In this work, we investigate how Large Language Models (LLMs) adapt their internal representations when encountering inputs …☆29Oct 23, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2609.17488☆4,424Nov 12, 2026Updated last week
- ☆1,084Oct 10, 2026Updated last month
- The next generation deep reinforcement learning tookit☆3,467Jun 16, 2023Updated 3 years ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆104Nov 9, 2024Updated 2 years ago
- 💰唯一正版💰 minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy 矿池抽水 矿池代理 矿池中转 矿池抽…☆3,885Updated this week
- [NeurIPS 2025🔥]Main source code of SRPO framework.☆193Nov 25, 2025Updated 11 months ago
- Code for the experiments and websites of the paper "Same Task, Different Circuits"☆38Jul 21, 2026Updated 3 months ago
- Paper list for the paper "Authorship Attribution in the Era of Large Language Models: Problems, Methodologies, and Challenges (SIGKDD Exp…☆20May 25, 2026Updated 5 months ago
- personal settings for linux tools, including zsh, vim, tmux, pip.☆11Dec 2, 2019Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [DEPRECATED] Legacy Klavis AI MCP integrations. See klavis.ai for RL environments and training data.☆5,824Nov 5, 2026Updated last week
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆6,221Updated this week
- ☆46Jan 4, 2026Updated 10 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆205Mar 4, 2024Updated 2 years ago
- Align Anything: Training All-modality Model with Feedback☆4,668Nov 27, 2025Updated 11 months ago
- ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skills☆15Oct 9, 2026Updated last month
- 智川x-agent☆1,094Aug 19, 2025Updated last year
Are these results useful?