explanare / ravel
Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
☆35Updated 3 months ago
Alternatives and similar repositories for ravel:
Users that are interested in ravel are comparing it to the libraries listed below
- ☆41Updated this week
- A library for efficient patching and automatic circuit discovery.☆46Updated last month
- ☆17Updated last month
- Sparse probing paper full code.☆53Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆27Updated 7 months ago
- ☆75Updated 5 months ago
- AI Logging for Interpretability and Explainability🔬☆97Updated 7 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 7 months ago
- ☆53Updated 2 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆89Updated 3 years ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆28Updated 2 months ago
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆39Updated last month
- ☆82Updated 11 months ago
- Steering Llama 2 with Contrastive Activation Addition☆113Updated 7 months ago
- How do transformer LMs encode relations?☆46Updated 10 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆21Updated 9 months ago
- ☆106Updated 5 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 9 months ago
- ☆131Updated 3 months ago
- Sparse Autoencoder Training Library☆38Updated 2 months ago
- ☆52Updated last year
- ☆18Updated last year
- Simple and scalable tools for data-driven pretraining data selection.☆14Updated this week
- Multi-Layer Sparse Autoencoders☆15Updated 3 weeks ago
- ☆44Updated last year
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆131Updated 3 months ago
- Algebraic value editing in pretrained language models☆62Updated last year
- ☆135Updated this week
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆58Updated last year