Alternatives and similar repositories for emergent-misalignment

Users that are interested in emergent-misalignment are comparing it to the libraries listed below

• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆109Updated 3 weeks ago
• google-deepmind / mishax
  ☆129Updated last month
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆92Updated last week
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆182Updated 6 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆132Updated this week
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆100Updated 2 months ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆172Updated this week
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆201Updated 5 months ago
• tilde-research / sieve
  Applying SAEs for fine-grained control
  ☆18Updated 5 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆217Updated 7 months ago
• METR / task-standard
  METR Task Standard
  ☆146Updated 3 months ago
• XuchanBao / behavioral-self-awareness
  ☆25Updated 2 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆156Updated this week
• hijohnnylin / neuronpedia
  open source interpretability platform 🧠
  ☆114Updated this week
• jerber / lang-jepa
  ☆111Updated 4 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆79Updated last month
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆203Updated 7 months ago
• METR / public-tasks
  ☆92Updated 2 months ago
• redwoodresearch / alignment_faking_public
  ☆58Updated 4 months ago
• UKGovernmentBEIS / control-arena
  ControlArena is a suite of realistic settings, mimicking complex deployment environments, for running control evaluations. This is an alp…
  ☆57Updated this week
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆245Updated 4 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆192Updated 3 months ago
• saprmarks / feature-circuits
  ☆167Updated last month
• jacobdunefsky / transcoder_circuits
  ☆112Updated 5 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆155Updated 2 weeks ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆94Updated 3 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆75Updated last year
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆526Updated this week
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆191Updated 5 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆86Updated 7 months ago