Algebraic value editing in pretrained language models
☆73Nov 1, 2023Updated 3 years ago
Alternatives and similar repositories for activation_additions
Users that are interested in activation_additions are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- An experimental tool to explore GPT-3's "miraculous" ability not only to spell its own token strings (it being a "character blind" model)…☆12Oct 3, 2023Updated 3 years ago
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated 2 years ago
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆30Nov 20, 2024Updated last year
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Steering Llama 2 with Contrastive Activation Addition☆259May 23, 2024Updated 2 years ago
- Sparse Autoencoder Training Library☆59May 1, 2025Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆587Jan 28, 2025Updated last year
- ☆120Aug 8, 2024Updated 2 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆278Feb 27, 2026Updated 8 months ago
- Easy training for Sparse Linear Autoencoders (https://arxiv.org/abs/2309.08600) with data from TransformerLens models.☆12Nov 1, 2023Updated 3 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆165Feb 21, 2025Updated last year
- Internalizing steering vectors via fine tuning☆12Sep 6, 2024Updated 2 years ago
- ☆26Dec 20, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tools for running experiments on RL agents in procgen environments☆19Apr 5, 2024Updated 2 years ago
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- ☆30Aug 2, 2024Updated 2 years ago
- A resource repository for representation engineering in large language models☆161Nov 14, 2024Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆89Mar 7, 2025Updated last year
- Code release for the paper "Style Vectors for Steering Generative Large Language Models", accepted to the Findings of the EACL 2024.☆38Sep 26, 2024Updated 2 years ago
- Quantifying degeneracy in toy models☆11Sep 6, 2024Updated 2 years ago
- ☆12Oct 23, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆301Oct 1, 2024Updated 2 years ago
- ☆57Oct 23, 2023Updated 3 years ago
- Sparse probing paper full code.☆69Dec 17, 2023Updated 2 years ago
- ☆10Jun 17, 2024Updated 2 years ago
- ☆149Aug 4, 2024Updated 2 years ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆43Jan 18, 2026Updated 9 months ago
- Erasing concepts from neural representations with provable guarantees☆272Jan 27, 2025Updated last year
- Representation Engineering: A Top-Down Approach to AI Transparency☆1,057Aug 14, 2024Updated 2 years ago
- Using sparse coding to find distributed representations used by neural networks.☆315Nov 10, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆37May 28, 2023Updated 3 years ago
- Repository for the SVD directions less wrong post☆12Dec 18, 2022Updated 3 years ago
- Finetune LLaMA-2-7b-chat to perform safety evaluation of user-bot conversation☆11Jun 2, 2025Updated last year
- Mechanistic Interpretability for Transformer Models☆55Jun 1, 2022Updated 4 years ago
- Code for 'The Linear Representation Hypothesis and the Geometry of Large Language Models' (ICML 2024)☆135Feb 11, 2025Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆106Sep 21, 2023Updated 3 years ago
- ☆33Jun 24, 2024Updated 2 years ago