minnesotanlp / cobbler
Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
☆17Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for cobbler
- Code and data for Marked Personas (ACL 2023)☆21Updated last year
- Codebase, data and models for the SummaC paper in TACL☆85Updated 11 months ago
- AVocaDo : Strategy for Adapting Vocabulary to Downstream Domain☆22Updated 2 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆15Updated 2 years ago
- [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models☆66Updated 6 months ago
- FRANK: Factuality Evaluation Benchmark☆52Updated last year
- ☆25Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 3 years ago
- The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).☆43Updated last year
- Test code of Inverse cloze task for information retrieval☆33Updated 3 years ago
- ☆44Updated last year
- ☆19Updated 7 months ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆40Updated 11 months ago
- ☆11Updated 2 months ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆41Updated 2 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- ☆38Updated last year
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆22Updated 7 months ago
- Code for ACL 2022 paper "Semi-Supervised Formality Style Transfer with Consistency Training".☆17Updated 2 years ago
- ☆21Updated 2 years ago
- ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy☆13Updated 3 years ago
- Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"☆60Updated last year
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆63Updated 2 years ago
- ☆12Updated 8 months ago
- ☆42Updated last year
- ☆11Updated 2 years ago
- ☆27Updated last year
- Implementation for https://arxiv.org/abs/2005.00652☆27Updated last year
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆21Updated 2 weeks ago
- Code for Handling Divergent Reference Texts when Evaluating Table-to-Text Generation (Dhingra et al. 2019)☆29Updated 3 years ago