[NeurIPS'26] In this work, we investigate how Large Language Models (LLMs) adapt their internal representations when encountering inputs of increasing difficulty, quantified as the degree of out-of-distribution (OOD) shift. We reveal a consistent and quantifiable phenomenon: as task difficulty increases, whether through harder reasoning question…
☆29Oct 23, 2026Updated last week
Alternatives and similar repositories for sparsityLLM
Users that are interested in sparsityLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- [FCS'24] LVLM Safety paper☆19Jan 4, 2025Updated last year
- [ICONIP'24]Mingyu.Jin's final year project☆30Aug 23, 2024Updated 2 years ago
- [EACL'26] DeepSieve: Information Sieving via LLM-as-a-Knowledge-Router☆107Jan 4, 2026Updated 9 months ago
- [ICML 2025] On the Emergence of Position Bias in Transformers☆11Nov 12, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The code for paper "MemGym: a Long-Horizon Memory Environment for LLM Agents".☆23Jun 2, 2026Updated 4 months ago
- The code for paper "EPO: Entropy-regularized Policy Optimization for LLM Agents Reinforcement Learning"☆40Jul 13, 2026Updated 3 months ago
- [ACL'24] Chain of Thought (CoT) is significant in improving the reasoning abilities of large language models (LLMs). However, the correla…☆47May 11, 2025Updated last year
- Contrastive sentence embedding with diverse augmentation☆12Dec 7, 2022Updated 3 years ago
- Official codebase for the Scattered Forest Search: Smarter Code Space Exploration and Inference Scaling with LLMs☆11Feb 20, 2025Updated last year
- [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?☆82Jan 22, 2025Updated last year
- ☆20Mar 25, 2025Updated last year
- [COLM 2024] LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models☆14Jan 4, 2025Updated last year
- MSWAL☆17Nov 7, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.☆88Nov 2, 2025Updated 11 months ago
- ☆15Feb 7, 2023Updated 3 years ago
- under review☆14Mar 1, 2021Updated 5 years ago
- [KDD Explore'24]Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities☆17May 7, 2025Updated last year
- [ACL 2026] This is the repo of Data Darwinism.☆27Apr 16, 2026Updated 6 months ago
- ☆16Nov 25, 2024Updated last year
- From Commands to Prompts: LLM-based Semantic File System for AIOS☆55Mar 9, 2025Updated last year
- Code for AutoGeo.☆18Aug 18, 2024Updated 2 years ago
- ☆20Jun 2, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆25May 17, 2025Updated last year
- Curated list of real-time video generation models for production deployment ⚡☆13Apr 15, 2026Updated 6 months ago
- Code to reproduce key results for "Interpreting Attention Layer Outputs with Sparse Autoencoders"☆11Jul 27, 2024Updated 2 years ago
- ☆22Oct 12, 2024Updated 2 years ago
- VAEGAN, I Love u☆16Aug 15, 2023Updated 3 years ago
- ☆11Nov 24, 2025Updated 11 months ago
- The implementation of FINER-MLLM, which is accepted by MM2024.☆18Oct 8, 2024Updated 2 years ago
- ☆43May 9, 2026Updated 5 months ago
- A curated collection of resources focused on the Mechanistic Interpretability (MI) of Large Multimodal Models (LMMs). This repository agg…☆223Mar 4, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆18May 7, 2026Updated 5 months ago
- Collection of Reverse Engineering in Large Model☆35Jan 8, 2025Updated last year
- ☆32Apr 4, 2024Updated 2 years ago
- 🚀 First survey on Attention Sink in Transformers — 200+ papers on utilization, interpretation, and mitigation.☆144Jun 5, 2026Updated 4 months ago
- [EMNLP 2025 Oral] 🎉 Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMs☆14Dec 10, 2025Updated 10 months ago
- [EMNLP main 2026]Co-Evolving World Models and Agent Policies for LLM Agents☆20Oct 5, 2026Updated 3 weeks ago
- ☆14Feb 21, 2026Updated 8 months ago