FeatureAlignment = Alignment + Mechanistic Interpretability
☆35Mar 8, 2025Updated last year
Alternatives and similar repositories for FeatureAlignment
Users that are interested in FeatureAlignment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Oct 11, 2026Updated 2 weeks ago
- PyTorch implementation of StableMask (ICML'24)☆15Jun 27, 2024Updated 2 years ago
- ☆28Oct 28, 2024Updated 2 years ago
- Trains Sparse Autoencoders based on outputs from language models☆11Oct 7, 2024Updated 2 years ago
- Papers and Related work to help learn ICL conveniently for everyone who interests.☆14Feb 28, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Collection of Reverse Engineering in Large Model☆35Jan 8, 2025Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆68Oct 27, 2024Updated 2 years ago
- Echos is a headless, API-driven DAW engine. It’s the backend for building AI tools that automate the entire music production lifecycle.☆53Nov 10, 2025Updated 11 months ago
- ☆29Oct 6, 2024Updated 2 years ago
- ☆23Aug 19, 2025Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆308Jan 22, 2026Updated 9 months ago
- ☆27May 14, 2026Updated 5 months ago
- Code and results on finding one-shot steering vectors that mediate emergent misalignment☆12Apr 12, 2025Updated last year
- Your finetuned model's back to its original safety standards faster than you can say "SafetyLock"!☆11Oct 16, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆610Jul 19, 2024Updated 2 years ago
- Applying SAEs for fine-grained control☆28Dec 15, 2024Updated last year
- Code for "Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers" (Findings of ACL 2024)☆12Aug 28, 2025Updated last year
- ☆16Jan 2, 2026Updated 9 months ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆17Dec 10, 2024Updated last year
- [ICLR 2025] PyTorch Implementation of "ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Time"☆34Jul 20, 2025Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated 2 years ago
- [NeurIPS 2024] GITA: Graph to Image-Text Integration for Vision-Language Graph Reasoning☆55Nov 25, 2025Updated 11 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆52May 31, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated last year
- A framework for training, analyzing, and visualizing sparse autoencoders and related interpretability methods☆232Oct 4, 2026Updated 3 weeks ago
- CS194-196 Course Project☆15Feb 20, 2025Updated last year
- ☆14Nov 29, 2024Updated last year
- [ICML 2025] Official code of "AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization"☆32Jan 10, 2026Updated 9 months ago
- smolbox of recipies☆30Apr 23, 2025Updated last year
- Code for SafeMERGE (ACL 2026).☆15Oct 2, 2026Updated 3 weeks ago
- ☆14Feb 24, 2025Updated last year
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆87Oct 26, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10May 21, 2017Updated 9 years ago
- Interleaving Reasoning: Next-Generation Reasoning Systems for AGI☆283Jun 5, 2026Updated 4 months ago
- ☆24Jun 13, 2024Updated 2 years ago
- Implementation of efficient test-time alignment methods.☆14Jan 13, 2026Updated 9 months ago
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆25Feb 16, 2026Updated 8 months ago
- [ICML 2026] Official implementation for paper: Learning Self-Correction in Vision–Language Models via Rollout Augmentation☆16Jun 4, 2026Updated 4 months ago