AlignmentResearch / tuned-lensLinks
Tools for understanding how transformer predictions are built layer-by-layer
☆559Updated 5 months ago
Alternatives and similar repositories for tuned-lens
Users that are interested in tuned-lens are comparing it to the libraries listed below
Sorting:
- ☆283Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆237Updated last year
- Mechanistic Interpretability Visualizations using React☆307Updated last year
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆849Updated 3 months ago
- Sparsify transformers with SAEs and transcoders☆681Updated 3 weeks ago
- ☆264Updated last year
- ☆132Updated 2 years ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆235Updated 3 weeks ago
- Erasing concepts from neural representations with provable guarantees☆242Updated 11 months ago
- Using sparse coding to find distributed representations used by neural networks.☆290Updated 2 years ago
- ☆244Updated last year
- ☆383Updated 4 months ago
- ☆193Updated last year
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆216Updated 3 weeks ago
- ☆561Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆285Updated last year
- ☆140Updated 2 weeks ago
- ☆135Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆206Updated last year
- This repository collects all relevant resources about interpretability in LLMs☆389Updated last year
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆758Updated this week
- Training Sparse Autoencoders on Language Models☆1,144Updated this week
- ☆202Updated 2 months ago
- Mass-editing thousands of facts into a transformer memory (ICLR 2023)☆534Updated last year
- Editing Models with Task Arithmetic☆524Updated 2 years ago
- Locating and editing factual associations in GPT (NeurIPS 2022)☆717Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆137Updated 10 months ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆564Updated 11 months ago
- Extract full next-token probabilities via language model APIs☆248Updated last year
- Representation Engineering: A Top-Down Approach to AI Transparency☆938Updated last year