meg-tong / sycophancy-evalView external linksLinks
datasets from the paper "Towards Understanding Sycophancy in Language Models"
☆102Oct 25, 2023Updated 2 years ago
Alternatives and similar repositories for sycophancy-eval
Users that are interested in sycophancy-eval are comparing it to the libraries listed below
Sorting:
- Evaluate the Quality of Critique☆36Jun 1, 2024Updated last year
- ☆51Oct 23, 2023Updated 2 years ago
- ☆43Sep 3, 2024Updated last year
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- ☆78May 22, 2024Updated last year
- Official repository for ALT (ALignment with Textual feedback).☆10Jul 25, 2024Updated last year
- [ICLR 2022] "Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How" by Yuning You, Yue Cao, Tianl…☆14Aug 19, 2022Updated 3 years ago
- Generative Judge for Evaluating Alignment☆250Jan 18, 2024Updated 2 years ago
- VehicleWorld is the first comprehensive multi-device environment for intelligent vehicle interaction that accurately models the complex, …☆21Sep 16, 2025Updated 5 months ago
- Code for the paper "Towards Reliable Simulation-Based Inference with Balanced Neural Ratio Estimation".☆14Nov 14, 2022Updated 3 years ago
- Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Experts☆16Feb 26, 2024Updated last year
- ☆99Aug 8, 2024Updated last year
- ☆329Jul 2, 2024Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆100Sep 21, 2023Updated 2 years ago
- Automatically create Anki cards from text using language models☆20Jan 7, 2023Updated 3 years ago
- Public repository for the Thermodynamic Neural Network File☆18Jan 15, 2020Updated 6 years ago
- Source code of paper “A Novel Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generation”☆16Nov 25, 2021Updated 4 years ago
- ☆16May 5, 2019Updated 6 years ago
- A library for mechanistic anomaly detection☆22Jan 9, 2025Updated last year
- Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"☆21Jul 31, 2023Updated 2 years ago
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆85Feb 5, 2024Updated 2 years ago
- ☆25Jun 22, 2023Updated 2 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆217Updated this week
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆570Jan 28, 2025Updated last year
- Code and data for the FACTOR paper☆54Nov 15, 2023Updated 2 years ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆107Mar 6, 2025Updated 11 months ago
- Run evals using LLM☆27Jan 8, 2026Updated last month
- This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"☆27Mar 30, 2023Updated 2 years ago
- ☆30Jun 19, 2023Updated 2 years ago
- Code and data associated with the AmbiEnt dataset in "We're Afraid Language Models Aren't Modeling Ambiguity" (Liu et al., 2023)☆64Feb 5, 2024Updated 2 years ago
- Exploring Few-Shot Adaptation of Language Models with Tables☆24Aug 22, 2022Updated 3 years ago
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆26Jun 27, 2024Updated last year
- ☆99Jun 27, 2024Updated last year
- Formalizing stochastic doubly-efficient debate☆118Oct 8, 2024Updated last year
- Benchmarking Benchmark Leakage in Large Language Models☆58May 20, 2024Updated last year
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆32Jul 28, 2023Updated 2 years ago
- Code for ICLR 2025 Failures to Find Transferable Image Jailbreaks Between Vision-Language Models☆37Jun 1, 2025Updated 8 months ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆554Feb 12, 2024Updated 2 years ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆121Aug 16, 2023Updated 2 years ago