IAAR-Shanghai / Awesome-Attention-HeadsLinks
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
☆393Updated 10 months ago
Alternatives and similar repositories for Awesome-Attention-Heads
Users that are interested in Awesome-Attention-Heads are comparing it to the libraries listed below
Sorting:
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆189Updated last year
- [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation☆181Updated 2 months ago
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆144Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆290Updated last month
- All-in-one Web Agent framework for post-training. Start building with a few clicks!☆275Updated 6 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆263Updated last year
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆171Updated last year
- ☆361Updated 7 months ago
- Benchmark for automated failure attributions in agentic systems (🏆 ICML 2025 Spotlight)☆337Updated last week
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆153Updated 5 months ago
- Controllable Text Generation for Large Language Models: A Survey☆199Updated last year
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆72Updated 9 months ago
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆98Updated last year
- Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!☆72Updated 9 months ago
- 📜 Paper list on decoding methods for LLMs and LVLMs☆67Updated 2 months ago
- Collection of Reverse Engineering in Large Model☆36Updated last year
- ☆260Updated 8 months ago
- Reproducing R1 for Code with Reliable Rewards☆282Updated 8 months ago
- A Unified Framework for High-Performance and Extensible LLM Steering☆154Updated last week
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆122Updated 3 months ago
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆186Updated last year
- ☆204Updated last month
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆150Updated last year
- FeatureAlignment = Alignment + Mechanistic Interpretability☆34Updated 10 months ago
- The repo for In-context Autoencoder☆165Updated last year
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆230Updated last year
- Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination.☆21Updated 6 months ago
- ☆73Updated 9 months ago
- Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning☆97Updated 11 months ago
- [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.☆87Updated 11 months ago