shuyhere / Awesome-Sparse-Autoencoder
Collection of Reverse Engineering in Large Model
☆32Updated 2 months ago
Alternatives and similar repositories for Awesome-Sparse-Autoencoder:
Users that are interested in Awesome-Sparse-Autoencoder are comparing it to the libraries listed below
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆56Updated 11 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆28Updated 2 weeks ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆52Updated 4 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆34Updated 2 months ago
- ☆93Updated last year
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆47Updated 2 weeks ago
- Function Vectors in Large Language Models (ICLR 2024)☆151Updated last week
- [NeurIPS 2024] How do Large Language Models Handle Multilingualism?☆29Updated 4 months ago
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆91Updated 5 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆71Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆107Updated 11 months ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆21Updated last month
- ☆16Updated 2 weeks ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆105Updated last week
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆69Updated 2 weeks ago
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆61Updated last month
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆71Updated last year
- ☆82Updated 7 months ago
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆15Updated last month
- ☆59Updated 6 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆29Updated 4 months ago
- ☆18Updated last month
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆74Updated 3 months ago
- ☆29Updated 10 months ago
- ☆49Updated 7 months ago
- Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"☆63Updated last year
- A resource repository for representation engineering in large language models☆115Updated 4 months ago
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆40Updated 10 months ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 4 months ago
- ☆83Updated 2 weeks ago