trestad / Factual-Recall-Mechanism
The code for paper Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
☆13Updated 7 months ago
Alternatives and similar repositories for Factual-Recall-Mechanism:
Users that are interested in Factual-Recall-Mechanism are comparing it to the libraries listed below
- Code for paper 'Are We Falling in a Middle-Intelligence Trap? An Analysis and Mitigation of the Reversal Curse'☆12Updated 3 months ago
- A Survey on the Honesty of Large Language Models☆48Updated last month
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆153Updated 9 months ago
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆24Updated 4 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆98Updated 7 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆102Updated 2 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆45Updated 7 months ago
- [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct☆121Updated 2 weeks ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆63Updated last year
- Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆61Updated last month
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆58Updated last year
- A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".☆39Updated last year
- ☆116Updated 4 months ago
- Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"☆16Updated last year
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆75Updated last month
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆88Updated 2 months ago
- AnchorAttention: Improved attention for LLMs long-context training☆156Updated this week
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆64Updated 5 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆84Updated 9 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆79Updated last month
- [ICLR 2024] Code for the paper "Sparse MoE with Language-Guided Routing for Multilingual Machine Translation"☆8Updated 6 months ago
- ☆22Updated last year
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆50Updated 7 months ago
- Implementation of the MATRIX framework (ICML 2024)☆39Updated 6 months ago
- The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"☆33Updated 10 months ago
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆52Updated 2 weeks ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆84Updated 6 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆127Updated 4 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆37Updated last week
- ☆65Updated 2 months ago