milesaturpin / cot-unfaithfulness
☆41Updated last year
Alternatives and similar repositories for cot-unfaithfulness:
Users that are interested in cot-unfaithfulness are comparing it to the libraries listed below
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 2 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆71Updated last month
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆52Updated last month
- General-purpose activation steering library☆57Updated 3 months ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆96Updated last month
- ☆25Updated this week
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆63Updated 2 weeks ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 2 months ago
- A library for efficient patching and automatic circuit discovery.☆62Updated last month
- ☆53Updated 2 years ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆22Updated 10 months ago
- Augmenting Statistical Models with Natural Language Parameters☆24Updated 6 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆93Updated last month
- ☆31Updated 3 months ago
- ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆33Updated 2 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 10 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆18Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆91Updated last year
- AI Logging for Interpretability and Explainability🔬☆111Updated 10 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 5 months ago
- ☆38Updated last year
- ☆82Updated 8 months ago
- ☆26Updated 9 months ago
- ☆31Updated last year
- ☆22Updated last month
- ☆19Updated last year
- ☆29Updated 11 months ago
- ☆36Updated 2 years ago
- Algebraic value editing in pretrained language models☆64Updated last year
- ☆14Updated 9 months ago