google-research-datasets / dices-dataset
This repository contains two datasets with multi-turn adversarial conversations generated by human agents interacting with a dialog model and rated for safety by two corresponding diverse rater pools.
☆25Updated 8 months ago
Alternatives and similar repositories for dices-dataset:
Users that are interested in dices-dataset are comparing it to the libraries listed below
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆41Updated 4 months ago
- ☆34Updated last year
- ☆38Updated last year
- Source code and data for ADEPT: A DEbiasing PrompT Framework (AAAI-23).☆14Updated 3 months ago
- Code repository for the paper "Mission: Impossible Language Models."☆50Updated last week
- How do transformer LMs encode relations?☆46Updated last year
- Evaluating the Moral Beliefs Encoded in LLMs☆24Updated 3 months ago
- ☆104Updated 10 months ago
- The Prism Alignment Project☆70Updated 11 months ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 4 months ago
- Inspecting and Editing Knowledge Representations in Language Models☆114Updated last year
- ☆89Updated last month
- Augmenting Statistical Models with Natural Language Parameters☆23Updated 6 months ago
- Repository for the Bias Benchmark for QA dataset.☆106Updated last year
- ☆35Updated 2 years ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆78Updated 11 months ago
- Tasks for describing differences between text distributions.☆16Updated 7 months ago
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆21Updated 3 weeks ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆95Updated last month
- ☆49Updated 7 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆59Updated last year
- ☆25Updated last year
- ☆19Updated last year
- This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".☆27Updated 7 months ago
- Supporting code for ReCEval paper☆28Updated 6 months ago
- Repo for: When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment☆38Updated last year
- Materials for EACL2024 tutorial: Transformer-specific Interpretability☆45Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆90Updated 3 years ago
- ☆37Updated 4 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆37Updated 2 weeks ago