msakarvadia / AttentionLens
Interpretating the latent space representations of attention head outputs for LLMs
☆32Updated 8 months ago
Alternatives and similar repositories for AttentionLens:
Users that are interested in AttentionLens are comparing it to the libraries listed below
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 5 months ago
- A library for efficient patching and automatic circuit discovery.☆63Updated this week
- ☆37Updated last year
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated last year
- Sparse Autoencoder Training Library☆48Updated 5 months ago
- ☆13Updated last year
- Universal Neurons in GPT2 Language Models☆27Updated 10 months ago
- ☆45Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 11 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆52Updated 5 months ago
- ☆28Updated last month
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆70Updated 3 weeks ago
- ☆22Updated 2 months ago
- Algebraic value editing in pretrained language models☆63Updated last year
- ☆26Updated last year
- ☆46Updated last month
- ☆51Updated 11 months ago
- ☆29Updated last week
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆31Updated 10 months ago
- ☆47Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆90Updated 3 years ago
- ☆82Updated 8 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆169Updated this week
- ☆39Updated 2 years ago
- ☆36Updated 2 months ago
- ☆16Updated 4 months ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated last year
- ☆31Updated last year
- ☆47Updated last year
- ☆18Updated 9 months ago