minjechoi / SOCKET
The official repo for SocKET: Social Knowledge Evaluation Tests
☆23Updated last year
Alternatives and similar repositories for SOCKET:
Users that are interested in SOCKET are comparing it to the libraries listed below
- ☆58Updated 2 years ago
- templates and other documents regarding responsible NLP research☆67Updated last year
- ☆38Updated last year
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- Extracting Cultural Commonsense Knowledge at Scale (WWW 2023)☆11Updated last year
- FRANK: Factuality Evaluation Benchmark☆54Updated 2 years ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆64Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆89Updated 2 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆77Updated 4 years ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆22Updated 3 weeks ago
- ☆22Updated last year
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 2 years ago
- Dataset + classifier tools to study social perception biases in natural language generation☆67Updated last year
- Data set for LREC 2020 paper "I Feel Offended, Don't Be Abusive!"☆18Updated last year
- ☆82Updated 2 years ago
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆21Updated 3 weeks ago
- ☆25Updated 3 years ago
- Data and code for the paper "The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems"☆19Updated last year
- The geometry of multilingual language model representations (EMNLP 2022).☆20Updated 2 years ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆14Updated 4 months ago
- Code for "From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Mod…☆35Updated last year
- Code and data for the EMNLP 2021 paper "Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts". Coming so…☆16Updated last year
- Data for evaluating gender bias in coreference resolution systems.☆74Updated 5 years ago
- WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…☆47Updated last year
- ☆39Updated 3 years ago
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 3 years ago
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆30Updated 5 months ago
- ☆16Updated 3 years ago