dig-team / hanna-benchmark-asgLinks
HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.
☆35Updated 11 months ago
Alternatives and similar repositories for hanna-benchmark-asg
Users that are interested in hanna-benchmark-asg are comparing it to the libraries listed below
Sorting:
- This code accompanies the paper DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.☆16Updated 2 years ago
- First explanation metric (diagnostic report) for text generation evaluation☆62Updated 6 months ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆41Updated 2 years ago
- [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.☆102Updated 2 years ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆59Updated last year
- ☆82Updated 2 years ago
- Code and Data for NeurIPS2021 Paper "A Dataset for Answering Time-Sensitive Questions"☆73Updated 3 years ago
- ☆78Updated last year
- The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".☆78Updated 2 years ago
- Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language Models (ACL 2024)☆54Updated 2 months ago
- Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning☆100Updated 2 years ago
- ☆28Updated last year
- ☆88Updated 2 years ago
- WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…☆47Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆80Updated last year
- ☆75Updated last year
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Updated 2 years ago
- [ACL 2024] Code for "MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation"☆39Updated last year
- [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding☆69Updated 3 years ago
- ☆33Updated 5 months ago
- Benchmark for evaluating open-ended generation☆50Updated 10 months ago
- ☆32Updated last year
- Code for Editing Factual Knowledge in Language Models☆140Updated 3 years ago
- The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Gene…☆26Updated last year
- ☆186Updated 2 months ago
- ☆50Updated 2 years ago
- ☆22Updated 3 years ago
- RARR: Researching and Revising What Language Models Say, Using Language Models☆48Updated 2 years ago
- ☆86Updated 2 years ago