openai / sparse_autoencoderLinks
☆561Updated last year
Alternatives and similar repositories for sparse_autoencoder
Users that are interested in sparse_autoencoder are comparing it to the libraries listed below
Sorting:
- Using sparse coding to find distributed representations used by neural networks.☆290Updated 2 years ago
- Sparsify transformers with SAEs and transcoders☆681Updated 3 weeks ago
- ☆383Updated 4 months ago
- Training Sparse Autoencoders on Language Models☆1,144Updated this week
- ☆193Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆285Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆237Updated last year
- ☆140Updated 2 weeks ago
- ☆264Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆235Updated 3 weeks ago
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆170Updated this week
- ☆202Updated 3 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆559Updated 5 months ago
- ☆227Updated last year
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆849Updated 3 months ago
- Mechanistic Interpretability Visualizations using React☆307Updated last year
- ☆58Updated last year
- ☆244Updated last year
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆758Updated this week
- This repository collects all relevant resources about interpretability in LLMs☆389Updated last year
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆327Updated 7 months ago
- ☆132Updated 2 years ago
- Steering Llama 2 with Contrastive Activation Addition☆206Updated last year
- ☆135Updated last year
- Representation Engineering: A Top-Down Approach to AI Transparency☆938Updated last year
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆50Updated last year
- RewardBench: the first evaluation tool for reward models.☆675Updated 7 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆614Updated last week
- Function Vectors in Large Language Models (ICLR 2024)☆190Updated 8 months ago
- Editing Models with Task Arithmetic☆524Updated 2 years ago