AlignmentResearch / tuned-lens
Tools for understanding how transformer predictions are built layer-by-layer
☆485Updated 10 months ago
Alternatives and similar repositories for tuned-lens:
Users that are interested in tuned-lens are comparing it to the libraries listed below
- ☆216Updated 6 months ago
- Mechanistic Interpretability Visualizations using React☆239Updated 3 months ago
- Using sparse coding to find distributed representations used by neural networks.☆230Updated last year
- ☆263Updated last year
- ☆115Updated 8 months ago
- Mass-editing thousands of facts into a transformer memory (ICLR 2023)☆476Updated last year
- Sparsify transformers with SAEs and transcoders☆511Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆192Updated 3 months ago
- Erasing concepts from neural representations with provable guarantees☆228Updated 2 months ago
- ☆200Updated last year
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆732Updated this week
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆166Updated this week
- Training Sparse Autoencoders on Language Models☆714Updated this week
- ☆121Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆137Updated 10 months ago
- Editing Models with Task Arithmetic☆463Updated last year
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆197Updated this week
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆539Updated last week
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆516Updated 2 months ago
- Interpretability for sequence generation models 🐛 🔍☆412Updated 5 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆156Updated 3 weeks ago
- This repository collects all relevant resources about interpretability in LLMs☆338Updated 5 months ago
- ☆91Updated 4 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆238Updated 8 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆94Updated last month
- Scaling Data-Constrained Language Models☆335Updated 6 months ago
- RewardBench: the first evaluation tool for reward models.☆547Updated last month
- ☆157Updated this week
- Locating and editing factual associations in GPT (NeurIPS 2022)☆619Updated 11 months ago