datasets from the paper "Towards Understanding Sycophancy in Language Models"
☆109Oct 25, 2023Updated 2 years ago
Alternatives and similar repositories for sycophancy-eval
Users that are interested in sycophancy-eval are comparing it to the libraries listed below
Sorting:
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- Improving transparency of large language models' reasoning☆15Nov 25, 2025Updated 3 months ago
- ☆52Oct 23, 2023Updated 2 years ago
- ☆336Jul 2, 2024Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆103Sep 21, 2023Updated 2 years ago
- ☆78May 22, 2024Updated last year
- Exploring Few-Shot Adaptation of Language Models with Tables☆24Aug 22, 2022Updated 3 years ago
- Measuring the situational awareness of language models☆40Feb 12, 2024Updated 2 years ago
- Automatically create Anki cards from text using language models☆20Jan 7, 2023Updated 3 years ago
- Code for ICLR 2025 Failures to Find Transferable Image Jailbreaks Between Vision-Language Models☆37Jun 1, 2025Updated 9 months ago
- PyTorch code for meta seq2seq learning☆43Jan 14, 2020Updated 6 years ago
- Official repository for ALT (ALignment with Textual feedback).☆10Jul 25, 2024Updated last year
- ☆43Sep 3, 2024Updated last year
- A library for mechanistic anomaly detection☆22Jan 9, 2025Updated last year
- Generative Judge for Evaluating Alignment☆248Jan 18, 2024Updated 2 years ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆121Aug 16, 2023Updated 2 years ago
- This repo is reproduction resources for linear alignment paper, still working☆18May 19, 2024Updated last year
- Benchmarking Benchmark Leakage in Large Language Models☆60May 20, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆573Jan 28, 2025Updated last year
- ☆104Aug 8, 2024Updated last year
- Source code of paper “A Novel Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generation”☆16Nov 25, 2021Updated 4 years ago
- Code and data for the FACTOR paper☆53Nov 15, 2023Updated 2 years ago
- Steering Llama 2 with Contrastive Activation Addition☆214May 23, 2024Updated last year
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆217Updated this week
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆63Feb 19, 2023Updated 3 years ago
- ☆51Oct 28, 2024Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆567Feb 12, 2024Updated 2 years ago
- [ICLR 2022] "Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How" by Yuning You, Yue Cao, Tianl…☆14Aug 19, 2022Updated 3 years ago
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆85Feb 5, 2024Updated 2 years ago
- MCP server for Oura API integration☆37Feb 27, 2025Updated last year
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆53Aug 10, 2025Updated 7 months ago
- ☆24Dec 2, 2023Updated 2 years ago
- Code for preprint: Summarizing Differences between Text Distributions with Natural Language☆43Feb 24, 2023Updated 3 years ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆107Mar 6, 2025Updated last year
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆25Dec 1, 2024Updated last year
- [ICLR 26] The official code repository for the paper "Mirage or Method? How Model–Task Alignment Induces Divergent RL Conclusions".☆17Feb 9, 2026Updated last month
- ☆99Jun 27, 2024Updated last year
- PyTorch implementation of "Weight Uncertainties in Neural Networks" (Bayes-by-Backprop)☆15Sep 10, 2018Updated 7 years ago
- A collection of research papers related to Natural Language Reasoning☆11May 27, 2022Updated 3 years ago