google-research-datasets / Attributed-QA
We believe the ability of an LLM to attribute the text that it generates is likely to be crucial for both system developers and users in information-seeking scenarios. This release consists of human-rated system outputs for a new question-answering task, Attributed Question Answering (AQA).
☆42Updated last year
Related projects: ⓘ
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆51Updated last year
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆79Updated last week
- ☆28Updated 7 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆77Updated last month
- Token-level Reference-free Hallucination Detection☆92Updated last year
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆58Updated 5 months ago
- A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution☆30Updated last year
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆90Updated last year
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆37Updated 2 months ago
- Repo for "On Learning to Summarize with Large Language Models as References"☆40Updated last year
- The codebase for our ACL2023 paper: Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learni…☆26Updated last year
- ☆97Updated 2 years ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆40Updated 8 months ago
- ☆66Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆39Updated 7 months ago
- ☆30Updated last year
- ☆55Updated last year
- The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…☆56Updated last year
- SILO Language Models code repository☆80Updated 6 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆118Updated 6 months ago
- ☆42Updated 2 months ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆38Updated 9 months ago
- Official codebase for permutation self-consistency.☆16Updated 7 months ago
- ☆64Updated 7 months ago
- Retrieval Augmented Generation Generalized Evaluation Dataset☆51Updated this week
- Repository for MuSiQue: Multi-hop Questions via Single-hop Question Composition, TACL 2022☆88Updated 3 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆41Updated last month
- A framework for few-shot evaluation of autoregressive language models.☆98Updated last year
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆109Updated last week
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆42Updated 8 months ago