minnesotanlp / cobblerLinks
Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
☆21Updated last year
Alternatives and similar repositories for cobbler
Users that are interested in cobbler are comparing it to the libraries listed below
Sorting:
- Code and data for Marked Personas (ACL 2023)☆28Updated 2 years ago
- [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models☆82Updated last year
- [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models☆74Updated last year
- Awesome LLM for NLG Evaluation Papers☆25Updated last year
- ☆13Updated 2 years ago
- ☆51Updated last year
- ☆78Updated last year
- ☆15Updated 3 years ago
- ☆17Updated 2 years ago
- ☆30Updated 9 months ago
- [ICLR 2022] Towards Continual Knowledge Learning of Language Models☆92Updated 2 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆147Updated last month
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- Codebase, data and models for the SummaC paper in TACL☆102Updated 8 months ago
- ☆75Updated last year
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆26Updated last month
- FRANK: Factuality Evaluation Benchmark☆59Updated 2 years ago
- code associated with ACL 2021 DExperts paper☆116Updated 2 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆22Updated 2 years ago
- ☆62Updated 2 years ago
- The official repo for SocKET: Social Knowledge Evaluation Tests☆24Updated 4 months ago
- ☆29Updated 2 years ago
- ☆22Updated 3 years ago
- ☆86Updated 2 years ago
- This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…☆124Updated last year
- ☆50Updated 2 years ago
- ☆17Updated 3 months ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆38Updated last year
- ☆51Updated 2 years ago