stanfordnlp / axbench
Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
☆62Updated last week
Alternatives and similar repositories for axbench:
Users that are interested in axbench are comparing it to the libraries listed below
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆72Updated 4 months ago
- ☆38Updated last year
- ☆82Updated 7 months ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 4 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆67Updated 9 months ago
- A library for efficient patching and automatic circuit discovery.☆59Updated last month
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 2 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 2 months ago
- Exploration of automated dataset selection approaches at large scales.☆33Updated 3 weeks ago
- ☆22Updated last month
- ☆61Updated 4 months ago
- Replicating O1 inference-time scaling laws☆83Updated 3 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆90Updated last month
- ☆59Updated last week
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆84Updated 4 months ago
- ☆49Updated 7 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆163Updated this week
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 10 months ago
- ☆23Updated last month
- ☆26Updated 8 months ago
- ☆46Updated last year
- Sparse Autoencoder Training Library☆43Updated 4 months ago
- [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)☆75Updated 5 months ago
- PyTorch library for Active Fine-Tuning☆61Updated last month
- ☆30Updated 2 months ago
- ☆34Updated last year
- ☆40Updated 3 weeks ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆73Updated last year
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆48Updated last month