Alternatives and similar repositories for crows-pairs

Users that are interested in crows-pairs are comparing it to the libraries listed below

• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆149Updated 2 months ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆81Updated 4 years ago
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆129Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆102Updated 8 months ago
• moinnadeem / StereoSet
  StereoSet: Measuring stereotypical bias in pretrained language models
  ☆191Updated 2 years ago
• SALT-NLP / implicit-hate
  ☆41Updated 2 years ago
• i-gallegos / Fair-LLM-Benchmark
  ☆154Updated 2 years ago
• s-nlp / paradetox
  Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"
  ☆32Updated 6 months ago
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆80Updated 6 years ago
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆56Updated 4 years ago
• acl-org / responsibleNLPresearch
  templates and other documents regarding responsible NLP research
  ☆70Updated 2 years ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆88Updated 4 years ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆202Updated 5 months ago
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆26Updated 2 months ago
• pliang279 / sent_debias
  [ACL 2020] Towards Debiasing Sentence Representations
  ☆66Updated 2 years ago
• kanekomasahiro / context-debias
  ☆25Updated 3 years ago
• Yixiao-Song / VeriScore
  ☆30Updated 10 months ago
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆22Updated 3 years ago
• neulab / BARTScore
  BARTScore: Evaluating Generated Text as Text Generation
  ☆360Updated 3 years ago
• realtimeqa / realtimeqa_public
  ☆78Updated last year
• thunlp / LLM-generated-text-detection
  ☆14Updated last year
• mcao516 / EntFA
  ☆27Updated 2 years ago
• allenai / real-toxicity-prompts
  ☆221Updated 4 years ago
• thu-coai / DiaSafety
  This repo is for the paper: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark
  ☆25Updated 3 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆118Updated 2 years ago
• SALT-NLP / mic
  Data and code for the paper "The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems"
  ☆21Updated 2 years ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆59Updated 2 years ago
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆394Updated 6 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆138Updated last year
• myracheng / markedpersonas
  Code and data for Marked Personas (ACL 2023)
  ☆28Updated 2 years ago