ruizheliUOA / Awesome-Interpretability-in-Large-Language-ModelsLinks
This repository collects all relevant resources about interpretability in LLMs
☆389Updated last year
Alternatives and similar repositories for Awesome-Interpretability-in-Large-Language-Models
Users that are interested in Awesome-Interpretability-in-Large-Language-Models are comparing it to the libraries listed below
Sorting:
- ☆223Updated last year
- Using sparse coding to find distributed representations used by neural networks.☆289Updated 2 years ago
- ☆192Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆285Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆288Updated this week
- ☆373Updated 4 months ago
- ☆261Updated last year
- ☆138Updated this week
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆843Updated 2 months ago
- ☆197Updated 2 months ago
- Steering Llama 2 with Contrastive Activation Addition☆201Updated last year
- Sparsify transformers with SAEs and transcoders☆676Updated this week
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆50Updated last year
- Materials for EACL2024 tutorial: Transformer-specific Interpretability☆61Updated last year
- Mechanistic Interpretability Visualizations using React☆303Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆234Updated last week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆233Updated last year
- Tools for understanding how transformer predictions are built layer-by-layer☆555Updated 4 months ago
- ☆83Updated 10 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆134Updated 10 months ago
- A resource repository for representation engineering in large language models☆143Updated last year
- ☆243Updated last year
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆168Updated this week
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆158Updated 6 months ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆100Updated 2 years ago
- ☆556Updated last year
- ☆134Updated last year
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆321Updated 6 months ago
- Sparse probing paper full code.☆66Updated 2 years ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆745Updated this week