nrimsky / LM-expView external linksLinks
LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
☆100Sep 21, 2023Updated 2 years ago
Alternatives and similar repositories for LM-exp
Users that are interested in LM-exp are comparing it to the libraries listed below
Sorting:
- Steering Llama 2 with Contrastive Activation Addition☆209May 23, 2024Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆80Mar 11, 2024Updated last year
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Experts☆16Feb 26, 2024Updated last year
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆20Oct 24, 2025Updated 3 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Mar 7, 2025Updated 11 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆567Aug 7, 2025Updated 6 months ago
- Algebraic value editing in pretrained language models☆68Nov 1, 2023Updated 2 years ago
- Interpretating the latent space representations of attention head outputs for LLMs☆36Aug 13, 2024Updated last year
- Benchmarking LLM Inference Speeds☆13Feb 4, 2026Updated last week
- ☆12Oct 23, 2022Updated 3 years ago
- ☆34Feb 11, 2025Updated last year
- ☆267Oct 1, 2024Updated last year
- ☆207Oct 14, 2025Updated 4 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆198Feb 13, 2025Updated last year
- Tools for studying developmental interpretability in neural networks.☆126Dec 30, 2025Updated last month
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆27Nov 20, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆570Jan 28, 2025Updated last year
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆108Mar 8, 2024Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆191Apr 17, 2025Updated 9 months ago
- ☆99Aug 8, 2024Updated last year
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆151Jul 19, 2024Updated last year
- ☆28May 4, 2023Updated 2 years ago
- Representation Engineering: A Top-Down Approach to AI Transparency☆947Aug 14, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆320Dec 18, 2024Updated last year
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated last year
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆16Sep 15, 2023Updated 2 years ago
- A library for mechanistic interpretability of GPT-style language models☆3,073Updated this week
- Steering vectors for transformer language models in Pytorch / Huggingface☆140Feb 21, 2025Updated 11 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆14Apr 15, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆240Dec 16, 2024Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆46Feb 8, 2026Updated last week
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆11Oct 23, 2023Updated 2 years ago
- Code for "Evidence of Learned Look-Ahead in a Chess-Playing Neural Network"☆26Jun 4, 2024Updated last year
- Machine Learning for Alignment Bootcamp☆81Apr 27, 2022Updated 3 years ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆342Jun 13, 2025Updated 8 months ago
- Code to enable layer-level steering in LLMs using sparse auto encoders☆28Sep 18, 2025Updated 4 months ago
- ☆23Jun 13, 2024Updated last year
- ☆23Apr 23, 2024Updated last year