Alternatives and similar repositories for sycophancy-intervention

Users that are interested in sycophancy-intervention are comparing it to the libraries listed below

• Re-Align / just-eval
  A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.
  ☆86Updated last year
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆153Updated last year
• SALT-NLP / demonstrated-feedback
  ☆126Updated 10 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆122Updated 8 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆163Updated 3 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆146Updated 9 months ago
• da03 / implicit_chain_of_thought
  ☆135Updated 9 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated 2 years ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆162Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated last year
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated last year
• oriyor / reasoning-on-cots
  Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"
  ☆96Updated last year
• JacobPfau / fillerTokens
  ☆67Updated last year
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆92Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆227Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆215Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆237Updated 9 months ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆158Updated last year
• Re-Align / URIAL
  ☆311Updated last year
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆200Updated 2 years ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆106Updated 6 months ago
• neulab / gemini-benchmark
  ☆149Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆112Updated 6 months ago
• abhika-m / FAVA
  ☆74Updated last year
• Lichang-Chen / InstructZero
  Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts…
  ☆195Updated last year