IAAR-Shanghai / Awesome-Attention-HeadsLinks
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
☆366Updated 6 months ago
Alternatives and similar repositories for Awesome-Attention-Heads
Users that are interested in Awesome-Attention-Heads are comparing it to the libraries listed below
Sorting:
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆183Updated 10 months ago
- [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation☆177Updated 6 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆169Updated 9 months ago
- All-in-one Web Agent framework for post-training. Start building with a few clicks!☆270Updated 2 months ago
- 🏆 ICML 2025 Spotlight☆304Updated 2 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆239Updated 11 months ago
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆144Updated last year
- ☆359Updated 3 months ago
- Controllable Text Generation for Large Language Models: A Survey☆187Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆269Updated 6 months ago
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆71Updated 5 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆226Updated 6 months ago
- ☆229Updated 4 months ago
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆184Updated last year
- The OlymMATH dataset☆19Updated 3 months ago
- ☆166Updated 4 months ago
- A Framework for LLM-based Multi-Agent Reinforced Training and Inference☆246Updated last month
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆108Updated 2 months ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆85Updated 7 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆118Updated last year
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆444Updated last year
- This is the repository of DEER, a Dynamic Early Exit in Reasoning method for Large Reasoning Language Models.☆171Updated 2 months ago
- ☆206Updated 5 months ago
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆448Updated last month
- The repo for In-context Autoencoder☆138Updated last year
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆108Updated last month
- Collection of Reverse Engineering in Large Model☆34Updated 8 months ago
- Benchmarking LLMs via Uncertainty Quantification☆246Updated last year
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆206Updated last week
- A recipe for online RLHF and online iterative DPO.☆529Updated 8 months ago