trestad / Factual-Recall-Mechanism
The code for paper Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
☆13Updated last year
Alternatives and similar repositories for Factual-Recall-Mechanism:
Users that are interested in Factual-Recall-Mechanism are comparing it to the libraries listed below
- Code for paper 'Are We Falling in a Middle-Intelligence Trap? An Analysis and Mitigation of the Reversal Curse'☆13Updated 8 months ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆65Updated 2 months ago
- ☆54Updated 2 weeks ago
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆36Updated 9 months ago
- The official repository for the paper "Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark"☆51Updated last week
- [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"☆44Updated 4 months ago
- Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024☆22Updated 10 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆60Updated last year
- ☆13Updated last year
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆72Updated this week
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆29Updated 2 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆42Updated last month
- ☆90Updated 3 months ago
- ☆52Updated this week
- ☆41Updated 2 weeks ago
- Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"☆20Updated last year
- ☆132Updated 9 months ago
- A Survey on the Honesty of Large Language Models☆57Updated 4 months ago
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆80Updated 4 months ago
- 🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆81Updated 4 months ago
- This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"☆62Updated this week
- A platform to develop CTM-motivated AI architecture.☆12Updated this week
- AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning☆23Updated 2 weeks ago
- awesome SAE papers☆26Updated 2 months ago
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year
- V1: Toward Multimodal Reasoning by Designing Auxiliary Task☆33Updated last week
- [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct☆169Updated 3 months ago
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆133Updated last month
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆75Updated 8 months ago
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆81Updated 10 months ago