minjechoi / SOCKETLinks
The official repo for SocKET: Social Knowledge Evaluation Tests
☆24Updated 4 months ago
Alternatives and similar repositories for SOCKET
Users that are interested in SOCKET are comparing it to the libraries listed below
Sorting:
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Updated last year
- Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Textual Style Transfer☆36Updated 2 years ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- ☆78Updated last year
- FRANK: Factuality Evaluation Benchmark☆59Updated 2 years ago
- Token-level Reference-free Hallucination Detection☆96Updated 2 years ago
- ☆50Updated 2 years ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆80Updated last year
- ☆58Updated 3 years ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆38Updated last year
- ☆51Updated last year
- Code base of In-Context Learning for Dialogue State tracking☆45Updated last year
- ☆50Updated 2 years ago
- [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models☆74Updated last year
- Detect hallucinated tokens for conditional sequence generation.☆64Updated 3 years ago
- Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"☆63Updated 2 years ago
- Codes for "Benchmarking the Generation of Fact Checking Explanations"☆10Updated last year
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆56Updated 4 years ago
- Data for evaluating gender bias in coreference resolution systems.☆80Updated 6 years ago
- Codebase, data and models for the SummaC paper in TACL☆100Updated 7 months ago
- Code for Editing Factual Knowledge in Language Models☆139Updated 3 years ago
- Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)☆112Updated 3 years ago
- First explanation metric (diagnostic report) for text generation evaluation☆62Updated 6 months ago
- Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.☆34Updated 2 years ago
- code associated with ACL 2021 DExperts paper☆116Updated 2 years ago
- ☆62Updated 2 years ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆42Updated 2 years ago
- Data and code for the paper "The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems"☆20Updated 2 years ago
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 4 years ago
- Codes and Datasets for our ACL 2023 paper on cognitive reframing of negative thoughts☆63Updated 2 years ago