wesg52 / llm-context-neurons
Find context neurons in Pythia models.
☆11Updated last year
Alternatives and similar repositories for llm-context-neurons:
Users that are interested in llm-context-neurons are comparing it to the libraries listed below
- Sparse probing paper full code.☆55Updated last year
- ☆29Updated last week
- ☆49Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆43Updated 6 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆90Updated 3 years ago
- A library for efficient patching and automatic circuit discovery.☆63Updated this week
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 3 months ago
- General-purpose activation steering library☆61Updated 3 months ago
- ☆82Updated 8 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆31Updated 10 months ago
- ☆91Updated 2 weeks ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆91Updated last year
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆37Updated 2 years ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆53Updated 5 months ago
- ☆93Updated last year
- Algebraic value editing in pretrained language models☆63Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆95Updated 2 months ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆73Updated last year
- Materials for EACL2024 tutorial: Transformer-specific Interpretability☆50Updated last year
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated last year
- How do transformer LMs encode relations?☆47Updated last year
- A resource repository for representation engineering in large language models☆119Updated 5 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆109Updated this week
- Conformal Language Modeling☆28Updated last year
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆75Updated 4 months ago
- ☆104Updated 5 months ago
- Using sparse coding to find distributed representations used by neural networks.☆236Updated last year
- ☆219Updated 6 months ago
- [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models☆80Updated 7 months ago
- "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)☆85Updated last year