ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
This repository collects all relevant resources about interpretability in LLMs
☆322Updated 4 months ago
Alternatives and similar repositories for Awesome-Interpretability-in-Large-Language-Models:
Users that are interested in Awesome-Interpretability-in-Large-Language-Models are comparing it to the libraries listed below
- Sparsify transformers with SAEs and transcoders☆476Updated this week
- Using sparse coding to find distributed representations used by neural networks.☆217Updated last year
- ☆120Updated 3 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆183Updated 2 months ago
- Training Sparse Autoencoders on Language Models☆637Updated this week
- Sparse Autoencoder for Mechanistic Interpretability☆217Updated 7 months ago
- Mechanistic Interpretability Visualizations using React☆235Updated 2 months ago
- ☆207Updated 5 months ago
- ☆153Updated this week
- ☆246Updated 2 weeks ago
- ☆144Updated this week
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆203Updated 4 months ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆503Updated this week
- Tools for understanding how transformer predictions are built layer-by-layer☆477Updated 9 months ago
- ☆110Updated 6 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆94Updated this week
- ☆429Updated 7 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆160Updated 3 months ago
- A resource repository for representation engineering in large language models☆107Updated 3 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆88Updated last week
- ☆120Updated last year
- ☆191Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆124Updated 9 months ago
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆706Updated last week
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆89Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆140Updated 4 months ago
- Improving Alignment and Robustness with Circuit Breakers☆187Updated 5 months ago
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆38Updated 9 months ago
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.☆326Updated this week
- Codebase for reproducing the experiments of the semantic uncertainty paper (short-phrase and sentence-length experiments).☆284Updated 10 months ago