Alternatives and similar repositories for control-evaluations

Users that are interested in control-evaluations are comparing it to the libraries listed below

• UKGovernmentBEIS / control-arena
  ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
  ☆115Updated last week
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆120Updated last year
• slavachalnev / SAE-TS
  Improving Steering Vectors by Targeting Sparse Autoencoder Features
  ☆25Updated 11 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆118Updated last year
• safety-research / safety-examples
  ☆19Updated last week
• TeunvdWeij / sandbagging
  ☆17Updated 11 months ago
• METR / RE-Bench
  ☆114Updated 2 weeks ago
• google-deepmind / dangerous-capability-evaluations
  ☆61Updated last month
• METR / task-standard
  METR Task Standard
  ☆163Updated 9 months ago
• redwoodresearch / alignment_faking_public
  ☆79Updated 3 weeks ago
• centerforaisafety / Intro_to_ML_Safety
  ☆75Updated 2 years ago
• clarifying-EM / model-organisms-for-EM
  Code repo for the model organisms and convergent directions of EM papers.
  ☆36Updated last month
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆32Updated last year
• aypan17 / machiavelli
  ☆138Updated 3 months ago
• XuchanBao / behavioral-self-awareness
  ☆32Updated 8 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆31Updated 2 years ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆136Updated 4 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆272Updated this week
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆127Updated 8 months ago
• redwoodresearch / Text-Steganography-Benchmark
  Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.
  ☆24Updated last year
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆59Updated last year
• safety-research / safety-tooling
  Inference API for many LLMs and other useful tools for empirical research
  ☆77Updated last week
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆238Updated last year
• max-andr / adversarial-random-search-gpt4
  Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]
  ☆43Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆28Updated last year
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆55Updated 6 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆78Updated 3 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆95Updated 2 years ago
• interp-reasoning / thought-anchors
  ⚓️ Repository for the "Thought Anchors: Which LLM Reasoning Steps Matter?" paper.
  ☆88Updated last week
• jacobdunefsky / llm-steering-opt
  Tools for optimizing steering vectors in LLMs.
  ☆14Updated 6 months ago