shuyhere / Awesome-Sparse-Autoencoder
Collection of Reverse Engineering in Large Model
☆31Updated last week
Alternatives and similar repositories for Awesome-Sparse-Autoencoder:
Users that are interested in Awesome-Sparse-Autoencoder are comparing it to the libraries listed below
- FeatureAlignment = Alignment + Mechanistic Interpretability☆26Updated this week
- ☆104Updated last month
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆50Updated 9 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆102Updated 9 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆82Updated this week
- ☆75Updated 5 months ago
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆39Updated last month
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆35Updated 8 months ago
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆73Updated 3 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆131Updated 3 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆61Updated 2 months ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆31Updated 2 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆197Updated 3 months ago
- Multi-Layer Sparse Autoencoders☆15Updated 3 weeks ago
- ☆43Updated 5 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆42Updated last month
- The Paper List on Data Contamination for Large Language Models Evaluation.☆86Updated last week
- A resource repository for representation engineering in large language models☆90Updated 2 months ago
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆15Updated last year
- LoFiT: Localized Fine-tuning on LLM Representations☆30Updated this week
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆94Updated 10 months ago
- AI Logging for Interpretability and Explainability🔬☆97Updated 7 months ago
- ☆29Updated 8 months ago
- ☆44Updated last year
- ☆85Updated last year
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆23Updated 6 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆58Updated last year
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆53Updated 3 months ago
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆69Updated last month
- [NeurIPS 2024] How do Large Language Models Handle Multilingualism?☆16Updated 2 months ago