🚀 First survey on Attention Sink in Transformers — 200+ papers on utilization, interpretation, and mitigation.
☆144Jun 5, 2026Updated 4 months ago
Alternatives and similar repositories for Awesome-Attention-Sink
Users that are interested in Awesome-Attention-Sink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR2026🔥Oral] SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving☆15Feb 26, 2026Updated 8 months ago
- The Github repo for our survey paper: "Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large…☆162Apr 15, 2026Updated 6 months ago
- ☆15Jan 20, 2026Updated 9 months ago
- [EMNLP 2025 Oral] 🎉 Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMs☆14Dec 10, 2025Updated 10 months ago
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory☆56May 17, 2026Updated 5 months ago
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?☆55Mar 16, 2026Updated 7 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆27Jul 7, 2025Updated last year
- SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving☆81Feb 28, 2026Updated 8 months ago
- ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skills☆15Oct 9, 2026Updated 3 weeks ago
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,797Aug 18, 2026Updated 2 months ago
- ☆20Mar 17, 2025Updated last year
- Foundations of Medical Large Language Model Learning☆2,129May 27, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. In…☆894Updated this week
- ☆36Jan 20, 2026Updated 9 months ago
- 🔥minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,minerproxy,矿池抽水,矿池中转,矿场运维专用☆3,703Jul 15, 2026Updated 3 months ago
- Curated, verified survey of the agent harness — the layer around an LLM (loop, tools, memory, context, runtime) that turns it into an a…☆53Updated this week
- The first open autoregressive foundational video AI model.☆2,893Oct 7, 2026Updated 3 weeks ago
- [NeurIPS'26] In this work, we investigate how Large Language Models (LLMs) adapt their internal representations when encountering inputs …☆29Updated this week
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,953May 20, 2026Updated 5 months ago
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2609.17488☆4,400Updated this week
- 🚀 First survey bridging LLM, RL, and Agentic Eras — 100+ papers on efficient inference from static generation to systematic reasoning an…☆15May 13, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Paper list for the paper "Authorship Attribution in the Era of Large Language Models: Problems, Methodologies, and Challenges (SIGKDD Exp…☆20May 25, 2026Updated 5 months ago
- The next generation deep reinforcement learning tookit☆3,467Jun 16, 2023Updated 3 years ago
- ☆1,082Oct 10, 2026Updated 2 weeks ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆205Mar 4, 2024Updated 2 years ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆104Nov 9, 2024Updated last year
- 💰唯一正版💰 minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy 矿池抽水 矿池代理 矿池中转 矿池抽…☆3,883Updated this week
- personal settings for linux tools, including zsh, vim, tmux, pip.☆11Dec 2, 2019Updated 6 years ago
- The code for paper "LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models"☆17Mar 2, 2025Updated last year
- [NeurIPS 2025🔥]Main source code of SRPO framework.☆193Nov 25, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆46Jan 4, 2026Updated 9 months ago
- Code for the experiments and websites of the paper "Same Task, Different Circuits"☆38Jul 21, 2026Updated 3 months ago
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆6,080Updated this week
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,830Jun 1, 2026Updated 4 months ago
- Align Anything: Training All-modality Model with Feedback☆4,669Nov 27, 2025Updated 11 months ago
- 智川x-agent☆1,090Aug 19, 2025Updated last year
- [CVPR 2026] Official Pytorch Code for ViKey: Enhancing Temporal Understanding in Videos via Visual Prompting☆12May 11, 2026Updated 5 months ago