FeatureAlignment = Alignment + Mechanistic Interpretability
☆34Mar 8, 2025Updated 11 months ago
Alternatives and similar repositories for FeatureAlignment
Users that are interested in FeatureAlignment are comparing it to the libraries listed below
Sorting:
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆29Feb 6, 2026Updated 3 weeks ago
- ☆15Aug 19, 2025Updated 6 months ago
- Trains Sparse Autoencoders based on outputs from language models☆11Oct 7, 2024Updated last year
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- ☆28Oct 28, 2024Updated last year
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆12Oct 31, 2024Updated last year
- Tools for optimizing steering vectors in LLMs.☆20Apr 10, 2025Updated 10 months ago
- A tiny easily hackable implementation of a feature dashboard.☆15Oct 21, 2025Updated 4 months ago
- CS194-196 Course Project☆14Feb 20, 2025Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆64Oct 27, 2024Updated last year
- PyTorch implementation of StableMask (ICML'24)☆15Jun 27, 2024Updated last year
- A benchmark for mechanistic discovery of circuits in Transformers☆16Dec 15, 2024Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆47May 31, 2024Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆293Jan 22, 2026Updated last month
- [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…☆47Aug 21, 2024Updated last year
- Applying SAEs for fine-grained control☆25Dec 15, 2024Updated last year
- ☆25Feb 20, 2026Updated last week
- ☆571Jul 19, 2024Updated last year
- ☆23Jun 13, 2024Updated last year
- [ICLR 2025] PyTorch Implementation of "ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Time"☆29Jul 20, 2025Updated 7 months ago
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆194Feb 18, 2026Updated last week
- NeurIPS'24 - LLM Safety Landscape☆39Oct 21, 2025Updated 4 months ago
- Code to enable layer-level steering in LLMs using sparse auto encoders☆30Sep 18, 2025Updated 5 months ago
- ☆27Oct 6, 2024Updated last year
- Mechanistic Interpretability in Transformers: This repository explores advanced techniques like Induction Head Detection and QK Circuit A…☆34Sep 27, 2024Updated last year
- AbstainQA, ACL 2024☆28Feb 4, 2026Updated 3 weeks ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆73Jan 16, 2026Updated last month
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆66Aug 15, 2025Updated 6 months ago
- ☆36Feb 26, 2024Updated 2 years ago
- ☆36Jun 13, 2025Updated 8 months ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆74Jun 23, 2025Updated 8 months ago
- ☆13Oct 5, 2025Updated 4 months ago
- ☆34Feb 6, 2026Updated 3 weeks ago
- smolbox of recipies☆29Apr 23, 2025Updated 10 months ago
- [NeurIPS 2024] Large Language Model Unlearning via Embedding-Corrupted Prompts☆38Sep 26, 2024Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆243Updated this week
- The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?☆42Nov 1, 2024Updated last year
- ☆231Nov 22, 2024Updated last year
- Build an AI bot in Discord to serve user's personalized reports on what's up in tech☆28Sep 14, 2025Updated 5 months ago