shuyhere / Awesome-Sparse-AutoencoderLinks
Collection of Reverse Engineering in Large Model
☆32Updated 5 months ago
Alternatives and similar repositories for Awesome-Sparse-Autoencoder
Users that are interested in Awesome-Sparse-Autoencoder are comparing it to the libraries listed below
Sorting:
- FeatureAlignment = Alignment + Mechanistic Interpretability☆28Updated 3 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆112Updated last year
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆37Updated 7 months ago
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆114Updated 8 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆59Updated last year
- ☆95Updated last year
- ☆44Updated 3 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆60Updated 7 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆39Updated 5 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆170Updated 2 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆56Updated 3 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆124Updated this week
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆32Updated 4 months ago
- A curated list of resources for activation engineering☆90Updated 3 weeks ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆88Updated 8 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆95Updated 2 weeks ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆72Updated 3 months ago
- ☆51Updated 2 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆72Updated 2 years ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆35Updated 7 months ago
- [ACL 2024 main] Aligning Large Language Models with Human Preferences through Representation Engineering (https://aclanthology.org/2024.…☆25Updated 9 months ago
- awesome SAE papers☆35Updated last month
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆32Updated last year
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆32Updated 9 months ago
- A Sober Look at Language Model Reasoning☆74Updated last week
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆32Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆25Updated 3 months ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆78Updated last year
- Code for Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities (NeurIPS'24)☆24Updated 6 months ago
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year