explanare / ravelLinks
Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
☆57Updated last month
Alternatives and similar repositories for ravel
Users that are interested in ravel are comparing it to the libraries listed below
Sorting:
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆12Updated 10 months ago
- [ICLR 2025] General-purpose activation steering library☆123Updated 2 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆84Updated 8 months ago
- ☆95Updated last year
- ☆51Updated 2 years ago
- ☆102Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆80Updated 4 months ago
- ☆110Updated 9 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆150Updated 5 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆67Updated last year
- ☆61Updated 4 months ago
- Algebraic value editing in pretrained language models☆66Updated 2 years ago
- ☆136Updated 2 weeks ago
- Sparse probing paper full code.☆65Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆195Updated last year
- Forcing Diffuse Distributions out of Language Models☆18Updated last year
- AI Logging for Interpretability and Explainability🔬☆133Updated last year
- ☆189Updated last year
- ☆57Updated 2 years ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆43Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆29Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆100Updated 2 years ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆99Updated 4 years ago
- ☆29Updated last year
- ☆22Updated 3 months ago
- [EMNLP 2025 Main] ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆38Updated 3 months ago
- Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"☆29Updated 11 months ago
- ☆196Updated last month
- ☆29Updated 9 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆28Updated last month