Algebraic value editing in pretrained language models
☆69Nov 1, 2023Updated 2 years ago
Alternatives and similar repositories for activation_additions
Users that are interested in activation_additions are comparing it to the libraries listed below
Sorting:
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆27Nov 20, 2024Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆213May 23, 2024Updated last year
- ☆27Nov 28, 2024Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Mar 7, 2025Updated last year
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- ☆100Aug 8, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆247Feb 27, 2026Updated last week
- Benchmarking LLM Inference Speeds☆13Feb 4, 2026Updated last month
- Sparse Autoencoder Training Library☆55May 1, 2025Updated 10 months ago
- ☆12Oct 23, 2022Updated 3 years ago
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 2 years ago
- ☆52Oct 23, 2023Updated 2 years ago
- ☆273Oct 1, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆572Jan 28, 2025Updated last year
- ☆17Feb 14, 2024Updated 2 years ago
- ☆153Dec 30, 2025Updated 2 months ago
- Erasing concepts from neural representations with provable guarantees☆243Jan 27, 2025Updated last year
- Tools for running experiments on RL agents in procgen environments☆20Apr 5, 2024Updated last year
- TACL 2025: Investigating Adversarial Trigger Transfer in Large Language Models☆19Aug 17, 2025Updated 6 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆140Feb 21, 2025Updated last year
- ☆32Feb 15, 2026Updated 3 weeks ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆102Sep 21, 2023Updated 2 years ago
- A resource repository for representation engineering in large language models☆148Nov 14, 2024Updated last year
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆11Oct 23, 2023Updated 2 years ago
- Applying SAEs for fine-grained control☆25Dec 15, 2024Updated last year
- Interpretating the latent space representations of attention head outputs for LLMs☆39Aug 13, 2024Updated last year
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆42Jan 18, 2026Updated last month
- ☆25Apr 23, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆20Oct 18, 2024Updated last year
- Sparse probing paper full code.☆67Dec 17, 2023Updated 2 years ago
- ☆140Aug 4, 2024Updated last year
- ☆30Aug 2, 2024Updated last year
- ☆24Jan 28, 2025Updated last year
- Using sparse coding to find distributed representations used by neural networks.☆297Nov 10, 2023Updated 2 years ago
- ☆89Dec 18, 2025Updated 2 months ago
- a script from ERNIE1.0 or ERNIE2.0 to transfomers' BERT format☆10Mar 28, 2020Updated 5 years ago