IAAR-Shanghai / Awesome-Attention-HeadsLinks
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
☆351Updated 3 months ago
Alternatives and similar repositories for Awesome-Attention-Heads
Users that are interested in Awesome-Attention-Heads are comparing it to the libraries listed below
Sorting:
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆177Updated 7 months ago
- [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation☆171Updated 3 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆168Updated 5 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆222Updated 7 months ago
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆147Updated last year
- A recipe for online RLHF and online iterative DPO.☆514Updated 5 months ago
- Controllable Text Generation for Large Language Models: A Survey☆175Updated 9 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆219Updated 3 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆213Updated 3 weeks ago
- All-in-one Web Agent framework for post-training. Start building with a few clicks!☆255Updated this week
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆243Updated 2 months ago
- ☆196Updated 3 weeks ago
- ☆293Updated this week
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆162Updated 9 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆434Updated last year
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆190Updated 8 months ago
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆374Updated 5 months ago
- Toolkit for Prompt Compression☆265Updated 3 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆253Updated 9 months ago
- Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models☆414Updated 2 weeks ago
- verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in…☆270Updated this week
- Recipes to train reward model for RLHF.☆1,356Updated last month
- Codebase for Iterative DPO Using Rule-based Rewards☆245Updated last month
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆220Updated last year
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆218Updated 2 weeks ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆314Updated 9 months ago
- ☆355Updated 7 months ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆52Updated 6 months ago
- AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models, ICLR 2025 (Outstanding Paper)☆250Updated last month
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆453Updated 7 months ago