wesg52 / sparse-probing-paperView external linksLinks
Sparse probing paper full code.
☆66Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for sparse-probing-paper
Users that are interested in sparse-probing-paper are comparing it to the libraries listed below
Sorting:
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 2 years ago
- Universal Neurons in GPT2 Language Models☆30May 28, 2024Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Oct 30, 2025Updated 3 months ago
- ☆99Aug 8, 2024Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆291Jul 20, 2024Updated last year
- ☆138Aug 4, 2024Updated last year
- Training Sparse Autoencoders on Language Models☆1,201Updated this week
- Mechanistic Interpretability Visualizations using React☆320Dec 18, 2024Updated last year
- ☆20Feb 17, 2023Updated 2 years ago
- ☆36Apr 30, 2024Updated last year
- ☆146Dec 30, 2025Updated last month
- ☆23Jun 13, 2024Updated last year
- Algebraic value editing in pretrained language models☆68Nov 1, 2023Updated 2 years ago
- Using sparse coding to find distributed representations used by neural networks.☆296Nov 10, 2023Updated 2 years ago
- Public experimental example code for the ProPublic recidivism data-based experiments for the upcoming Interpretable Active Learning Paper☆10Dec 18, 2017Updated 8 years ago
- Tools for understanding how transformer predictions are built layer-by-layer☆567Aug 7, 2025Updated 6 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,073Updated this week
- Links to publications that focus on the interpretation and analysis of in-context learning☆15Oct 17, 2024Updated last year
- ☆12Jul 12, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆240Dec 16, 2024Updated last year
- ☆198Nov 17, 2024Updated last year
- ☆28May 4, 2023Updated 2 years ago
- [NeurIPS 2025 MechInterp Workshop - Spotlight] Official implementation of the paper "RelP: Faithful and Efficient Circuit Discovery in La…☆25Nov 3, 2025Updated 3 months ago
- Code for the paper "XAI Beyond Classification: Interpretable Neural Clustering" (JMLR 2022)☆13Mar 12, 2022Updated 3 years ago
- Sparsify transformers with SAEs and transcoders☆692Updated this week
- ☆14Feb 26, 2024Updated last year
- ☆1,069Mar 6, 2024Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆241Updated this week
- ☆389Aug 21, 2025Updated 5 months ago
- ☆17Apr 14, 2021Updated 4 years ago
- Azure OpenAI 프롬프톤☆11Sep 23, 2024Updated last year
- Code for "Preference Tuning For Toxicity Mitigation Generalizes Across Languages." Paper accepted at Findings of EMNLP 2024☆18Mar 25, 2025Updated 10 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆83Nov 27, 2024Updated last year
- Codebase for running (conditional) probing experiments☆22Nov 13, 2022Updated 3 years ago
- ☆207Oct 14, 2025Updated 4 months ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆238Aug 11, 2025Updated 6 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Mar 7, 2025Updated 11 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆135Sep 14, 2022Updated 3 years ago