safety-research / persona_vectorsLinks
Persona Vectors: Monitoring and Controlling Character Traits in Language Models
☆284Updated 3 months ago
Alternatives and similar repositories for persona_vectors
Users that are interested in persona_vectors are comparing it to the libraries listed below
Sorting:
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆299Updated 5 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆141Updated 4 months ago
- This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen,…☆53Updated 11 months ago
- Improving Alignment and Robustness with Circuit Breakers☆242Updated last year
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆163Updated this week
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆195Updated 6 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆159Updated last week
- Open source interpretability artefacts for R1.☆163Updated 7 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆108Updated 3 weeks ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆121Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆129Updated 9 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆250Updated 6 months ago
- ☆226Updated 3 weeks ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆202Updated last year
- Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Ref…☆68Updated 8 months ago
- Code for the paper: "Learning to Reason without External Rewards"☆375Updated 4 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆214Updated last year
- ☆222Updated 8 months ago
- ☆293Updated 4 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆192Updated 9 months ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆172Updated last year
- [ICLR 2025] General-purpose activation steering library☆119Updated 2 months ago
- ☆154Updated last month
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆268Updated last month
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆311Updated 3 weeks ago
- Steering Llama 2 with Contrastive Activation Addition☆193Updated last year
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆364Updated last week
- [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example☆376Updated last month
- AWM: Agent Workflow Memory☆355Updated 9 months ago
- ☆188Updated last year