UlisseMini / activation_additions_hf
Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models
☆13Updated last year
Alternatives and similar repositories for activation_additions_hf:
Users that are interested in activation_additions_hf are comparing it to the libraries listed below
- Algebraic value editing in pretrained language models☆63Updated last year
- ☆211Updated 5 months ago
- A library for efficient patching and automatic circuit discovery.☆59Updated last month
- Tools for studying developmental interpretability in neural networks.☆86Updated 2 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 10 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆14Updated 11 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆90Updated last month
- ☆26Updated last year
- ☆26Updated 11 months ago
- ☆121Updated last year
- Experiments with representation engineering☆11Updated last year
- Redwood Research's transformer interpretability tools☆14Updated 2 years ago
- Mechanistic Interpretability for Transformer Models☆50Updated 2 years ago
- Mechanistic Interpretability Visualizations using React☆235Updated 3 months ago
- ☆61Updated 4 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 2 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆190Updated 3 months ago
- Sparse Autoencoder Training Library☆43Updated 4 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆117Updated 2 years ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆178Updated last year
- ☆150Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆100Updated 4 months ago
- ☆19Updated 2 years ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆73Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆91Updated last year
- ☆18Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆72Updated 3 months ago
- Steering Llama 2 with Contrastive Activation Addition☆131Updated 10 months ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆197Updated last week
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆76Updated 2 years ago