Alternatives and similar repositories for open-source-alignment-faking

Users that are interested in open-source-alignment-faking are comparing it to the libraries listed below

• safety-research / SHADE-Arena

  View on GitHub
  ☆21Jun 22, 2025Updated 7 months ago
• ethz-spylab / unlearning-vs-safety

  View on GitHub
  ☆27Oct 6, 2024Updated last year
• safety-research / finetuning-auditor

  View on GitHub
  Auditing agents for fine-tuning safety
  ☆18Oct 21, 2025Updated 3 months ago
• safety-research / safety-examples

  View on GitHub
  ☆25Nov 11, 2025Updated 3 months ago
• aengusl / latent-adversarial-training

  View on GitHub
  ☆47Sep 29, 2024Updated last year
• safety-research / safety-tooling

  View on GitHub
  Inference API for many LLMs and other useful tools for empirical research
  ☆104Feb 6, 2026Updated last week
• Jiaxin-Wen / Unsupervised-Elicitation

  View on GitHub
  ☆40Jul 6, 2025Updated 7 months ago
• clarifying-EM / model-organisms-for-EM

  View on GitHub
  Code repo for the model organisms and convergent directions of EM papers.
  ☆49Sep 22, 2025Updated 4 months ago
• TeunvdWeij / sandbagging

  View on GitHub
  ☆20Nov 15, 2024Updated last year
• usyd-fsalab / NeuralNetworkRandomness

  View on GitHub
  ☆14Mar 18, 2022Updated 3 years ago
• tianyu139 / tangent-model-composition

  View on GitHub
  Code for Tangent Model Composition for Ensembling and Continual Fine-tuning (ICCV 2023) and Tangent Transformers for Composition, Privacy…
  ☆13May 14, 2024Updated last year
• lasgroup / SafetyPolytope

  View on GitHub
  Learning Safety Constraints for Large Language Models (ICML2025)
  ☆29Aug 4, 2025Updated 6 months ago
• jkutaso / SHADE-Arena

  View on GitHub
  ☆35May 9, 2025Updated 9 months ago
• hijohnnylin / automated-interpretability

  View on GitHub
  ☆22Updated this week
• noanabeshima / tinymodel

  View on GitHub
  A TinyStories LM with SAEs and transcoders
  ☆14Apr 3, 2025Updated 10 months ago
• rgreenblatt / control-evaluations

  View on GitHub
  ☆20May 25, 2024Updated last year
• QinbinLi / LLM-PBE

  View on GitHub
  A toolkit to assess data privacy in LLMs (under development)
  ☆67Jan 2, 2025Updated last year
• cvenhoff / steering-thinking-llms

  View on GitHub
  ☆33Jul 9, 2025Updated 7 months ago
• dtch1997 / steering-bench

  View on GitHub
  Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"
  ☆19Dec 14, 2024Updated last year
• litian96 / AdaDPS

  View on GitHub
  Private Adaptive Optimization with Side Information (ICML '22)
  ☆16Jun 23, 2022Updated 3 years ago
• NLie2 / what_features_jailbreak_LLMs

  View on GitHub
  ☆18Mar 30, 2025Updated 10 months ago
• tianyu139 / meaning-as-trajectories

  View on GitHub
  Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)
  ☆22May 14, 2024Updated last year
• IBM / sae-steering

  View on GitHub
  Code to enable layer-level steering in LLMs using sparse auto encoders
  ☆28Sep 18, 2025Updated 4 months ago
• rubenpt91 / PFL-DocVQA-Competition

  View on GitHub
  ☆21Oct 23, 2024Updated last year
• annahdo / implementing_activation_steering

  View on GitHub
  A collection of different ways to implement accessing and modifying internal model activations for LLMs
  ☆21Oct 18, 2024Updated last year
• callummcdougall / sae_vis

  View on GitHub
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆240Dec 16, 2024Updated last year
• ApolloResearch / e2e_sae

  View on GitHub
  Sparse Autoencoder Training Library
  ☆56May 1, 2025Updated 9 months ago
• ApolloResearch / insider-trading

  View on GitHub
  ☆58Feb 12, 2024Updated 2 years ago
• zikuicai / aegisllm

  View on GitHub
  ☆33Sep 26, 2025Updated 4 months ago
• huanranchen / LLMLandscape

  View on GitHub
  The loss landscape of Large Language Models resemble basin!
  ☆36Jul 8, 2025Updated 7 months ago
• Jayfeather1024 / Backdoor-Enhanced-Alignment

  View on GitHub
  ☆24Dec 8, 2024Updated last year
• rishub-tamirisa / tamper-resistance

  View on GitHub
  [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆66Jun 9, 2025Updated 8 months ago
• ckkissane / crosscoder-model-diff-replication

  View on GitHub
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆64Oct 27, 2024Updated last year
• METR / vivaria

  View on GitHub
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆134Updated this week
• science-of-finetuning / diffing-toolkit

  View on GitHub
  A toolkit that provides a range of model diffing techniques including a UI to visualize them interactively.
  ☆57Updated this week
• UCSB-NLP-Chang / causal_unlearn

  View on GitHub
  [EMNLP 2024] "Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective"
  ☆32Jul 22, 2024Updated last year
• bilal-chughtai / rep-theory-mech-interp

  View on GitHub
  ☆28May 4, 2023Updated 2 years ago
• jbloomAus / SAEDashboard

  View on GitHub
  ☆88Dec 18, 2025Updated last month
• andyrdt / refusal_direction

  View on GitHub
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆342Jun 13, 2025Updated 8 months ago