JoshEngels / SAE-Dark-Matter
Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"
☆21Updated last month
Alternatives and similar repositories for SAE-Dark-Matter:
Users that are interested in SAE-Dark-Matter are comparing it to the libraries listed below
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆21Updated 3 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆161Updated this week
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 9 months ago
- Sparse and discrete interpretability tool for neural networks☆59Updated last year
- ☆61Updated 4 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆70Updated 3 months ago
- ☆80Updated 7 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆90Updated 3 weeks ago
- ☆89Updated last month
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆66Updated 9 months ago
- A mechanistic approach for understanding and detecting factual errors of large language models.☆41Updated 8 months ago
- NeurIPS 2024 tutorial on LLM Inference☆39Updated 3 months ago
- Measuring the situational awareness of language models☆34Updated last year
- ☆26Updated 11 months ago
- A library for efficient patching and automatic circuit discovery.☆57Updated last month
- ☆113Updated 7 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated 11 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆185Updated 3 months ago
- ☆20Updated 5 months ago
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆26Updated 2 weeks ago
- ☆32Updated 3 weeks ago
- ☆26Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆45Updated 4 months ago
- Sparse Autoencoder Training Library☆42Updated 4 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆41Updated 3 months ago
- ☆121Updated last year
- ☆38Updated last year
- ☆34Updated last year
- ☆21Updated 5 months ago