MaheepChaudhary / SAE-RavelLinks
Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the paper "Evaluating Open-Source Sparse Autoencoders on Disentangling Factual Knowledge in GPT-2 Small"
☆11Updated 5 months ago
Alternatives and similar repositories for SAE-Ravel
Users that are interested in SAE-Ravel are comparing it to the libraries listed below
Sorting:
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆49Updated 9 months ago
- ☆45Updated last year
- A library for efficient patching and automatic circuit discovery.☆70Updated 2 months ago
- ☆29Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆60Updated 7 months ago
- General-purpose activation steering library☆83Updated 2 months ago
- ☆95Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆74Updated 4 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆26Updated last year
- AI Logging for Interpretability and Explainability🔬☆124Updated last year
- ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆36Updated 5 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆99Updated 2 weeks ago
- Restore safety in fine-tuned language models through task arithmetic☆28Updated last year
- ☆51Updated 2 years ago
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆17Updated last year
- ☆87Updated 11 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆40Updated last year
- [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…☆33Updated 2 years ago
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆17Updated last year
- Forcing Diffuse Distributions out of Language Models☆16Updated 10 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆77Updated 6 months ago
- ☆49Updated last year
- ☆14Updated last year
- ☆51Updated 3 months ago
- ☆43Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆78Updated last year
- Sparse probing paper full code.☆58Updated last year
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆27Updated last year
- ☆12Updated 2 months ago
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆27Updated 4 months ago