zyxnlp / ICL-Interpretation-Analysis-ResourcesLinks
Links to publications that focus on the interpretation and analysis of in-context learning
☆12Updated last year
Alternatives and similar repositories for ICL-Interpretation-Analysis-Resources
Users that are interested in ICL-Interpretation-Analysis-Resources are comparing it to the libraries listed below
Sorting:
- Codebase for Paper Reusing Embeddings: Reproducible Reward Model Research in Large Language Model Alignment without GPUs☆21Updated 8 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Updated 10 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆290Updated 2 weeks ago
- A resource repository for representation engineering in large language models☆145Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆68Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆120Updated 10 months ago
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆89Updated 9 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆48Updated last year
- ☆51Updated 2 years ago
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆34Updated 11 months ago
- [NeurIPS 2024] How do Large Language Models Handle Multilingualism?☆50Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆204Updated last year
- ☆68Updated 5 months ago
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆40Updated last year
- ☆57Updated 2 years ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆100Updated 2 years ago
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆26Updated last year
- [ICLR 2025] General-purpose activation steering library☆133Updated 3 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆44Updated 11 months ago
- ☆70Updated last year
- ☆116Updated last year
- awesome SAE papers☆69Updated 7 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆79Updated last year
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆168Updated this week
- ☆68Updated 10 months ago
- ☆46Updated last year
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆29Updated last year
- ☆193Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Updated 2 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆34Updated 10 months ago