AsaCooperStickland / situational-awareness-evals

Related projects: ⓘ

• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆14Updated 8 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆59Updated 10 months ago
• EleutherAI / sae-auto-interp
  ☆54Updated last week
• saprmarks / feature-circuits
  ☆75Updated this week
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆52Updated last month
• callummcdougall / sae_visualizer
  ☆24Updated 5 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆51Updated 7 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆56Updated 3 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆76Updated 3 weeks ago
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆48Updated 2 years ago
• google-deepmind / mishax
  ☆91Updated last month
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆83Updated 3 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆39Updated 2 months ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆62Updated last year
• Aaquib111 / edge-attribution-patching
  Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"
  ☆22Updated 3 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆70Updated 5 months ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆73Updated 11 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆57Updated last week
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆55Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆84Updated 9 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆124Updated 2 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆74Updated last month
• architsharma97 / dpo-rlaif
  ☆87Updated 2 months ago
• shauli-ravfogel / rlace-icml
  ☆33Updated 2 years ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆23Updated 3 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆16Updated 5 months ago
• jacobdunefsky / transcoder_circuits
  ☆33Updated 3 months ago
• alan-cooney / transformer-lens-starter-template
  A quick way to get started with Transformer Lens
  ☆11Updated 9 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆66Updated last month
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆133Updated last month