MaheepChaudhary / SAE-Ravel
Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the paper "Evaluating Open-Source Sparse Autoencoders on Disentangling Factual Knowledge in GPT-2 Small"
☆11Updated 2 months ago
Alternatives and similar repositories for SAE-Ravel:
Users that are interested in SAE-Ravel are comparing it to the libraries listed below
- ☆38Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆22Updated 9 months ago
- ☆17Updated 3 weeks ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆52Updated 4 months ago
- ☆29Updated 11 months ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆42Updated 5 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 2 months ago
- ☆23Updated last month
- A library for efficient patching and automatic circuit discovery.☆62Updated last month
- LoFiT: Localized Fine-tuning on LLM Representations☆34Updated 2 months ago
- Augmenting Statistical Models with Natural Language Parameters☆23Updated 6 months ago
- General-purpose activation steering library☆54Updated 2 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆30Updated 10 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆71Updated 3 weeks ago
- ☆13Updated last year
- ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆33Updated last month
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆62Updated this week
- Code for "Universal Adversarial Triggers Are Not Universal."☆16Updated 11 months ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆22Updated last month
- Algebraic value editing in pretrained language models☆63Updated last year
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆17Updated 11 months ago
- EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue☆35Updated 4 months ago
- ☆22Updated last month
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 4 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 10 months ago
- Learning adapter weights from task descriptions☆16Updated last year
- ☆44Updated 6 months ago
- Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"☆21Updated 3 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated last year
- ☆37Updated last year