IAAR-Shanghai / Awesome-Attention-HeadsLinks
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
☆377Updated 8 months ago
Alternatives and similar repositories for Awesome-Attention-Heads
Users that are interested in Awesome-Attention-Heads are comparing it to the libraries listed below
Sorting:
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆185Updated last year
- [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation☆176Updated 8 months ago
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆144Updated last year
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆169Updated 10 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆277Updated 7 months ago
- ☆360Updated 4 months ago
- All-in-one Web Agent framework for post-training. Start building with a few clicks!☆273Updated 3 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆248Updated last year
- 🏆 ICML 2025 Spotlight☆320Updated 3 months ago
- Controllable Text Generation for Large Language Models: A Survey☆192Updated last year
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆478Updated 3 months ago
- Toolkit for Prompt Compression☆278Updated 8 months ago
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆253Updated last month
- Recipes to train the self-rewarding reasoning LLMs.☆227Updated 8 months ago
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆72Updated 7 months ago
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆185Updated last year
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆184Updated last week
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆193Updated last year
- Code, benchmark and environment for "ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows"☆117Updated 2 months ago
- Collection of Reverse Engineering in Large Model☆35Updated 9 months ago
- A recipe for online RLHF and online iterative DPO.☆536Updated 10 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆448Updated last year
- ☆244Updated 5 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆259Updated last year
- A Framework for LLM-based Multi-Agent Reinforced Training and Inference☆326Updated this week
- [ICLR 2025 Workshop] "Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models"☆37Updated 2 months ago
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆93Updated 11 months ago
- Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning☆96Updated 8 months ago
- ☆41Updated last month
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆259Updated 5 months ago