shuyhere / Awesome-Sparse-Autoencoder
Collection of Reverse Engineering in Large Model
☆32Updated 3 months ago
Alternatives and similar repositories for Awesome-Sparse-Autoencoder:
Users that are interested in Awesome-Sparse-Autoencoder are comparing it to the libraries listed below
- FeatureAlignment = Alignment + Mechanistic Interpretability☆28Updated last month
- ☆27Updated last month
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆53Updated 5 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆72Updated last month
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆57Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆108Updated last year
- ☆34Updated last month
- ☆93Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆161Updated last week
- ☆104Updated 5 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆52Updated last month
- ☆82Updated 8 months ago
- A curated list of resources for activation engineering☆65Updated 2 weeks ago
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆29Updated 10 months ago
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆75Updated 2 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 5 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆109Updated 2 weeks ago
- ☆22Updated 7 months ago
- Code for Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities (NeurIPS'24)☆21Updated 4 months ago
- A resource repository for representation engineering in large language models☆119Updated 5 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆71Updated 2 years ago
- LoFiT: Localized Fine-tuning on LLM Representations☆37Updated 3 months ago
- ☆91Updated 2 months ago
- Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering☆57Updated 4 months ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆22Updated 2 months ago
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆17Updated 2 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆30Updated 5 months ago
- General-purpose activation steering library☆61Updated 3 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆52Updated 5 months ago
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆23Updated 9 months ago