Alternatives and similar repositories for sycophancy-eval:

Users that are interested in sycophancy-eval are comparing it to the libraries listed below

• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆64Updated 8 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆100Updated 10 months ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆88Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆123Updated 8 months ago
• saprmarks / geometry-of-truth
  ☆76Updated 6 months ago
• architsharma97 / dpo-rlaif
  ☆95Updated 7 months ago
• milesaturpin / cot-unfaithfulness
  ☆36Updated last year
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆65Updated 11 months ago
• montemac / activation_additions
  Algebraic value editing in pretrained language models
  ☆62Updated last year
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆53Updated this week
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆88Updated this week
• da03 / Internalize_CoT_Step_by_Step
  ☆149Updated 2 weeks ago
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆93Updated this week
• aypan17 / machiavelli
  ☆128Updated 3 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆62Updated 3 months ago
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆52Updated 8 months ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 9 months ago
• EleutherAI / delphi
  ☆151Updated this week
• HannahKirk / prism-alignment
  The Prism Alignment Project
  ☆66Updated 9 months ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆40Updated 2 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆52Updated 4 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆31Updated 6 months ago
• balevinstein / Probes
  ☆47Updated last year
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆22Updated 7 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆47Updated 2 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆84Updated last week
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆99Updated last year
• ArthurConmy / Automatic-Circuit-Discovery
  ☆205Updated 4 months ago