minjechoi / SOCKETLinks
The official repo for SocKET: Social Knowledge Evaluation Tests
☆23Updated 3 weeks ago
Alternatives and similar repositories for SOCKET
Users that are interested in SOCKET are comparing it to the libraries listed below
Sorting:
- ☆16Updated 3 years ago
- ☆29Updated 3 years ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated last year
- ☆40Updated last year
- This repo contains the dataset for the EMNLP 2022 paper "Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts…☆19Updated last year
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆55Updated 4 years ago
- Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.☆34Updated last year
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆15Updated 2 years ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆41Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆55Updated 2 years ago
- ☆22Updated last year
- ☆17Updated 2 years ago
- ☆48Updated 2 years ago
- Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"☆25Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆23Updated 2 months ago
- Contrastive Fact Verification☆71Updated 2 years ago
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆24Updated 2 months ago
- Codebase, data and models for the SummaC paper in TACL☆94Updated 4 months ago
- Extracting Cultural Commonsense Knowledge at Scale (WWW 2023)☆11Updated last year
- Can Large Language Models Be an Alternative to Human Evaluations?☆9Updated last year
- Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Textual Style Transfer☆34Updated 2 years ago
- ☆48Updated 2 years ago
- ☆20Updated 2 years ago
- ☆58Updated 3 years ago
- ☆20Updated 5 months ago
- code for our EACL 2021 paper: "Challenges in Automated Debiasing for Toxic Language Detection" by Xuhui Zhou, Maarten Sap, Swabha Swayamd…☆19Updated 3 years ago
- ☆44Updated 3 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆82Updated 4 years ago
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆15Updated last year