minnesotanlp / cobbler
Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
☆17Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for cobbler
- AVocaDo : Strategy for Adapting Vocabulary to Downstream Domain☆22Updated 2 years ago
- The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).☆43Updated last year
- Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"☆60Updated last year
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 3 years ago
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆63Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆85Updated 10 months ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆39Updated 10 months ago
- [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models☆66Updated 5 months ago
- FRANK: Factuality Evaluation Benchmark☆52Updated last year
- Test code of Inverse cloze task for information retrieval☆33Updated 3 years ago
- Detect hallucinated tokens for conditional sequence generation.☆63Updated 2 years ago
- Code for Handling Divergent Reference Texts when Evaluating Table-to-Text Generation (Dhingra et al. 2019)☆29Updated 3 years ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆41Updated 2 years ago
- Code and data for Marked Personas (ACL 2023)☆21Updated last year
- ☆57Updated 2 years ago
- ☆44Updated last year
- ☆61Updated 2 years ago
- 🐥 Code and Dataset for our EMNLP 2022 paper - "ProsocialDialog: A Prosocial Backbone for Conversational Agents"☆60Updated last year
- [ICLR 2022] Towards Continual Knowledge Learning of Language Models☆93Updated 2 years ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆84Updated 2 years ago
- ☆11Updated last month
- code associated with ACL 2021 DExperts paper☆113Updated last year
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆47Updated last year
- Benchmarking Commonsense Reasoning in Real-World Tasks☆13Updated 10 months ago
- ☆41Updated 3 years ago
- ☆29Updated last year
- The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".☆64Updated 2 years ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆21Updated this week
- ☆25Updated 2 years ago
- ☆15Updated 2 years ago