safety-research / persona_vectorsLinks
Persona Vectors: Monitoring and Controlling Character Traits in Language Models
☆344Updated 6 months ago
Alternatives and similar repositories for persona_vectors
Users that are interested in persona_vectors are comparing it to the libraries listed below
Sorting:
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆163Updated 7 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆337Updated 7 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆163Updated 2 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆140Updated 11 months ago
- [ICLR 2026] Learning to Reason without External Rewards☆388Updated this week
- Improving Alignment and Robustness with Circuit Breakers☆255Updated last year
- This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen,…☆55Updated last year
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆246Updated 8 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆120Updated last month
- Open source interpretability artefacts for R1.☆169Updated 9 months ago
- ☆227Updated 11 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆197Updated 11 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆124Updated last year
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆175Updated last week
- Steering Llama 2 with Contrastive Activation Addition☆207Updated last year
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆260Updated 8 months ago
- ☆229Updated last year
- ☆217Updated this week
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆418Updated last week
- A toolkit for describing model features and intervening on those features to steer behavior.☆227Updated last month
- https://transformer-circuits.pub/2025/attribution-graphs/methods.html☆91Updated 10 months ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆183Updated last year
- ☆195Updated last year
- Official implementation of the NeurIPS 2025 paper "Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space"☆304Updated last week
- Collection of evals for Inspect AI☆349Updated this week
- [ICLR 2025] General-purpose activation steering library☆138Updated 4 months ago
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆112Updated last year
- ☆257Updated 2 weeks ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆205Updated last year
- AWM: Agent Workflow Memory☆387Updated last month