msakarvadia / AttentionLens
Interpretating the latent space representations of attention head outputs for LLMs
☆24Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for AttentionLens
- ☆44Updated last year
- ☆50Updated 2 weeks ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆19Updated last year
- ☆21Updated last week
- ☆40Updated 2 years ago
- Tasks for describing differences between text distributions.☆16Updated 3 months ago
- ☆50Updated last year
- ☆32Updated last year
- ☆46Updated last month
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆17Updated 6 months ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆34Updated last year
- ☆12Updated 2 years ago
- ☆27Updated last year
- Few-shot Learning with Auxiliary Data☆26Updated 11 months ago
- ☆24Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆31Updated last month
- Minimum Description Length probing for neural network representations☆16Updated 2 weeks ago
- ☆24Updated 4 months ago
- ☆14Updated 8 months ago
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆49Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated last year
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆18Updated 2 months ago
- ☆24Updated 8 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆17Updated 7 months ago
- ☆21Updated 2 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆69Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆25Updated 5 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- ☆45Updated 9 months ago
- ☆18Updated last month