FeatureAlignment = Alignment + Mechanistic Interpretability
☆34Mar 8, 2025Updated last year
Alternatives and similar repositories for FeatureAlignment
Users that are interested in FeatureAlignment are comparing it to the libraries listed below
Sorting:
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆29Feb 6, 2026Updated last month
- ☆28Oct 28, 2024Updated last year
- Trains Sparse Autoencoders based on outputs from language models☆11Oct 7, 2024Updated last year
- PyTorch implementation of StableMask (ICML'24)☆15Jun 27, 2024Updated last year
- [ICLR 2025] PyTorch Implementation of "ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Time"☆30Jul 20, 2025Updated 8 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆63Oct 27, 2024Updated last year
- Applying SAEs for fine-grained control☆25Dec 15, 2024Updated last year
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆294Jan 22, 2026Updated last month
- ☆24Aug 23, 2025Updated 6 months ago
- ☆578Jul 19, 2024Updated last year
- CS194-196 Course Project☆14Feb 20, 2025Updated last year
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆12Oct 31, 2024Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆47May 31, 2024Updated last year
- ☆36Feb 26, 2024Updated 2 years ago
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆200Updated this week
- ☆26Sep 3, 2025Updated 6 months ago
- ☆25Feb 20, 2026Updated last month
- A tiny easily hackable implementation of a feature dashboard.☆16Oct 21, 2025Updated 4 months ago
- ☆13Nov 29, 2024Updated last year
- Code to enable layer-level steering in LLMs using sparse auto encoders☆31Sep 18, 2025Updated 6 months ago
- [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…☆47Aug 21, 2024Updated last year
- ☆26Oct 6, 2024Updated last year
- Tools for optimizing steering vectors in LLMs.☆20Apr 10, 2025Updated 11 months ago
- AbstainQA, ACL 2024☆29Feb 4, 2026Updated last month
- PyTorch implementation of the Mamba-3 architecture☆73Updated this week
- Your finetuned model's back to its original safety standards faster than you can say "SafetyLock"!☆11Oct 16, 2024Updated last year
- Official implementation of Visco-Attack (EMNLP 2025 Main). We will progressively release the code and one-click reproduction scripts.☆30Aug 22, 2025Updated 6 months ago
- Collection of Reverse Engineering in Large Model☆37Jan 8, 2025Updated last year
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆87Oct 26, 2025Updated 4 months ago
- [NeurIPS 2024] GITA: Graph to Image-Text Integration for Vision-Language Graph Reasoning☆53Nov 25, 2025Updated 3 months ago
- A benchmark for mechanistic discovery of circuits in Transformers☆16Dec 15, 2024Updated last year
- Code for COLING 2022 paper "FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognition"☆15Jan 15, 2023Updated 3 years ago
- [ACL 2025] Data and Code for Paper VLSBench: Unveiling Visual Leakage in Multimodal Safety☆57Jul 21, 2025Updated 7 months ago
- This is a sample project for getting started with Unity and data visualization.☆11Jun 5, 2020Updated 5 years ago
- ☆10Jun 10, 2024Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆245Updated this week
- ASSIST: Towards Label Noise-Robust Dialogue State Tracking☆10Apr 11, 2022Updated 3 years ago
- ☆19Aug 10, 2024Updated last year