google-research-datasets / dices-datasetLinks
This repository contains two datasets with multi-turn adversarial conversations generated by human agents interacting with a dialog model and rated for safety by two corresponding diverse rater pools.
☆26Updated last year
Alternatives and similar repositories for dices-dataset
Users that are interested in dices-dataset are comparing it to the libraries listed below
Sorting:
- Tasks for describing differences between text distributions.☆16Updated 11 months ago
- Resolving Knowledge Conflicts in Large Language Models, COLM 2024☆17Updated last month
- This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".☆30Updated 11 months ago
- Evaluating the Moral Beliefs Encoded in LLMs☆26Updated 7 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆61Updated 2 years ago
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆29Updated 6 months ago
- ☆35Updated 2 years ago
- Repo for: When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment☆38Updated 2 years ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆44Updated 7 months ago
- ☆43Updated last year
- Finding semantically meaningful and accurate prompts.☆47Updated last year
- The Prism Alignment Project☆79Updated last year
- Aioli: A unified optimization framework for language model data mixing☆27Updated 6 months ago
- Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"☆19Updated 2 years ago
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 4 years ago
- ☆44Updated 10 months ago
- Code and data for the FACTOR paper☆48Updated last year
- ☆110Updated last year
- This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers☆30Updated last year
- ☆22Updated 7 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆41Updated 5 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Updated last year
- ☆28Updated 4 months ago
- Source code and data for ADEPT: A DEbiasing PrompT Framework (AAAI-23).☆15Updated 7 months ago
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆24Updated 4 months ago
- ☆23Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆27Updated 10 months ago
- ☆19Updated last year
- Code/data for MARG (multi-agent review generation)☆44Updated 8 months ago
- Inspecting and Editing Knowledge Representations in Language Models☆116Updated last year