Sparse probing paper full code.
☆67Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for sparse-probing-paper
Users that are interested in sparse-probing-paper are comparing it to the libraries listed below
Sorting:
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 2 years ago
- Universal Neurons in GPT2 Language Models☆30May 28, 2024Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Oct 30, 2025Updated 4 months ago
- ☆100Aug 8, 2024Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆292Jul 20, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆328Dec 18, 2024Updated last year
- Training Sparse Autoencoders on Language Models☆1,233Feb 27, 2026Updated last week
- ☆20Feb 17, 2023Updated 3 years ago
- ☆36Apr 30, 2024Updated last year
- ☆23Jun 13, 2024Updated last year
- Algebraic value editing in pretrained language models☆69Nov 1, 2023Updated 2 years ago
- Using sparse coding to find distributed representations used by neural networks.☆297Nov 10, 2023Updated 2 years ago
- Public experimental example code for the ProPublic recidivism data-based experiments for the upcoming Interpretable Active Learning Paper☆10Dec 18, 2017Updated 8 years ago
- A library for mechanistic interpretability of GPT-style language models☆3,133Updated this week
- ☆12Jul 12, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆247Feb 27, 2026Updated last week
- ☆28May 4, 2023Updated 2 years ago
- ☆200Nov 17, 2024Updated last year
- Code for the paper "XAI Beyond Classification: Interpretable Neural Clustering" (JMLR 2022)☆13Mar 12, 2022Updated 3 years ago
- Sparsify transformers with SAEs and transcoders☆699Updated this week
- A TinyStories LM with SAEs and transcoders☆14Apr 3, 2025Updated 11 months ago
- [NeurIPS 2025 MechInterp Workshop - Spotlight] Official implementation of the paper "RelP: Faithful and Efficient Circuit Discovery in La…☆27Nov 3, 2025Updated 4 months ago
- ☆14Feb 26, 2024Updated 2 years ago
- ☆1,074Mar 6, 2024Updated 2 years ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆244Updated this week
- ☆399Aug 21, 2025Updated 6 months ago
- ☆17Apr 14, 2021Updated 4 years ago
- Code for "Preference Tuning For Toxicity Mitigation Generalizes Across Languages." Paper accepted at Findings of EMNLP 2024☆18Mar 25, 2025Updated 11 months ago
- Azure OpenAI 프롬프톤☆11Sep 23, 2024Updated last year
- Codebase for running (conditional) probing experiments☆22Nov 13, 2022Updated 3 years ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆84Nov 27, 2024Updated last year
- ☆209Oct 14, 2025Updated 4 months ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆240Aug 11, 2025Updated 6 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Mar 7, 2025Updated 11 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆137Sep 14, 2022Updated 3 years ago
- ☆134Oct 28, 2023Updated 2 years ago
- Data from the publication "Multi-Domain Goal-Oriented Dialogues (MultiDoGO): Strategies toward Curating and Annotating Large Scale Dialog…☆25Dec 3, 2020Updated 5 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆205Dec 22, 2021Updated 4 years ago