jettjaniak / chainscopeLinks
Repository for the "Chain-of-Thought Reasoning In The Wild Is Not Always Faithful" paper
☆30Updated 3 weeks ago
Alternatives and similar repositories for chainscope
Users that are interested in chainscope are comparing it to the libraries listed below
Sorting:
- A toolkit for describing model features and intervening on those features to steer behavior.☆221Updated last week
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆231Updated last week
- ⚓️ Repository for the "Thought Anchors: Which LLM Reasoning Steps Matter?" paper.☆95Updated last month
- Steering vectors for transformer language models in Pytorch / Huggingface☆132Updated 9 months ago
- Open source interpretability artefacts for R1.☆165Updated 7 months ago
- ☆111Updated 10 months ago
- Sparse Autoencoder for Mechanistic Interpretability☆286Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆232Updated last year
- Evaluating the Moral Beliefs Encoded in LLMs☆31Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆63Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆198Updated last year
- ☆82Updated 2 months ago
- ☆82Updated this week
- ☆29Updated last year
- This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen,…☆55Updated last year
- Code for the arXiv preprint "Answer, Assemble, Ace: Understanding How Transformers Answer Multiple Choice Questions"☆15Updated 4 months ago
- ☆191Updated last year
- ☆260Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆248Updated last year
- ☆195Updated 2 months ago
- ☆84Updated 10 months ago
- ☆36Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆100Updated 2 years ago
- Using sparse coding to find distributed representations used by neural networks.☆289Updated 2 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆215Updated this week
- Mechanistic Interpretability Visualizations using React☆304Updated last year
- An attribution library for LLMs☆46Updated last year
- ☆132Updated 2 years ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆316Updated 6 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆135Updated last week