shuyhere / Awesome-Sparse-Autoencoder
Collection of Reverse Engineering in Large Model
☆32Updated 4 months ago
Alternatives and similar repositories for Awesome-Sparse-Autoencoder
Users that are interested in Awesome-Sparse-Autoencoder are comparing it to the libraries listed below
Sorting:
- ☆31Updated 2 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆57Updated 5 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆28Updated 2 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆166Updated 3 weeks ago
- ☆94Updated last year
- LoFiT: Localized Fine-tuning on LLM Representations☆38Updated 4 months ago
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆29Updated 11 months ago
- awesome SAE papers☆27Updated 2 months ago
- ☆29Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆72Updated 2 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆32Updated 6 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆57Updated last year
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆105Updated 7 months ago
- ☆51Updated last month
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆71Updated 2 years ago
- A curated list of resources for activation engineering☆74Updated last week
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆55Updated 2 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆109Updated last year
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆113Updated this week
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆17Updated 3 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆72Updated 7 months ago
- ☆34Updated 2 months ago
- ☆112Updated 5 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 6 months ago
- ☆23Updated 7 months ago
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆25Updated 2 months ago
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆82Updated 5 months ago
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆80Updated 2 months ago
- A resource repository for representation engineering in large language models☆120Updated 6 months ago
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…☆29Updated 5 months ago