google / belief-localizationLinks
This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Can Be Injected in Language Models."
☆61Updated 2 years ago
Alternatives and similar repositories for belief-localization
Users that are interested in belief-localization are comparing it to the libraries listed below
Sorting:
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆97Updated 4 years ago
- Inspecting and Editing Knowledge Representations in Language Models☆117Updated 2 years ago
- ☆92Updated last year
- ☆98Updated last year
- ☆66Updated 2 years ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆80Updated last year
- ☆112Updated 3 years ago
- ☆22Updated 2 years ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆12Updated 9 months ago
- ☆44Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆56Updated last year
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆68Updated 2 years ago
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆40Updated last year
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆19Updated 4 months ago
- A library for efficient patching and automatic circuit discovery.☆78Updated 3 months ago
- PASTA: Post-hoc Attention Steering for LLMs☆125Updated 11 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆78Updated 2 years ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆39Updated 2 years ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆47Updated last year
- ☆45Updated last year
- ☆52Updated 6 months ago
- Augmenting Statistical Models with Natural Language Parameters☆28Updated last year
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆81Updated 10 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆78Updated 2 years ago
- Tasks for describing differences between text distributions.☆17Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆27Updated last year
- ☆32Updated last year
- This repository contains data, code and models for contextual noncompliance.☆24Updated last year
- Restore safety in fine-tuned language models through task arithmetic☆29Updated last year