IAAR-Shanghai / Awesome-Attention-Heads
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
☆344Updated last month
Alternatives and similar repositories for Awesome-Attention-Heads:
Users that are interested in Awesome-Attention-Heads are comparing it to the libraries listed below
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆172Updated 5 months ago
- [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation☆165Updated 2 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆166Updated 4 months ago
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆147Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆227Updated last month
- All-in-one Web Agent framework for post-training. Start building with a few clicks!☆243Updated 2 months ago
- A recipe for online RLHF and online iterative DPO.☆507Updated 3 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆209Updated 6 months ago
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆189Updated 7 months ago
- Controllable Text Generation for Large Language Models: A Survey☆170Updated 7 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆248Updated 7 months ago
- Toolkit for Prompt Compression☆252Updated 2 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆213Updated last month
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆190Updated last week
- Benchmarking LLMs via Uncertainty Quantification☆223Updated last year
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆349Updated 4 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆203Updated last year
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆156Updated 8 months ago
- Paper list for Efficient Reasoning.☆403Updated this week
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆70Updated 3 weeks ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆96Updated 8 months ago
- ☆106Updated 8 months ago
- Fantastic Data Engineering for Large Language Models☆87Updated 3 months ago
- The repo for In-context Autoencoder☆122Updated 11 months ago
- A Survey on Data Selection for Language Models☆225Updated 6 months ago
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆133Updated last month
- LLM hallucination paper list☆314Updated last year
- A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.☆189Updated last month
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆459Updated last year
- ☆351Updated 5 months ago