safety-research / persona_vectorsLinks
Persona Vectors: Monitoring and Controlling Character Traits in Language Models
☆304Updated 4 months ago
Alternatives and similar repositories for persona_vectors
Users that are interested in persona_vectors are comparing it to the libraries listed below
Sorting:
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆316Updated 6 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆151Updated 5 months ago
- Improving Alignment and Robustness with Circuit Breakers☆248Updated last year
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆225Updated 6 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆254Updated 7 months ago
- This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen,…☆54Updated last year
- Open source interpretability artefacts for R1.☆164Updated 7 months ago
- ☆230Updated 2 weeks ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆159Updated last month
- A toolkit for describing model features and intervening on those features to steer behavior.☆221Updated this week
- Steering vectors for transformer language models in Pytorch / Huggingface☆132Updated 9 months ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆391Updated 3 weeks ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆113Updated last week
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆174Updated last year
- ☆226Updated 9 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆122Updated last year
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆202Updated last year
- Code for the paper: "Learning to Reason without External Rewards"☆382Updated 5 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆193Updated 10 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆322Updated last month
- [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example☆385Updated 3 weeks ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆234Updated 4 months ago
- ☆160Updated 2 months ago
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆168Updated this week
- Official implementation of the NeurIPS 2025 paper "Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space"☆286Updated this week
- ☆302Updated 4 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆231Updated last week
- ☆200Updated 7 months ago
- Collection of evals for Inspect AI☆305Updated this week
- ☆200Updated 2 weeks ago