Alternatives and similar repositories for crows-pairs:

Users that are interested in crows-pairs are comparing it to the libraries listed below

• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆128Updated last month
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆94Updated last year
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆54Updated 3 years ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆70Updated 3 years ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆87Updated 2 weeks ago
• i-gallegos / Fair-LLM-Benchmark
  ☆118Updated last year
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆72Updated 5 years ago
• SALT-NLP / implicit-hate
  ☆39Updated last year
• mcao516 / EntFA
  ☆25Updated 2 years ago
• moinnadeem / StereoSet
  StereoSet: Measuring stereotypical bias in pretrained language models
  ☆169Updated 2 years ago
• princeton-nlp / MABEL
  EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975
  ☆37Updated last year
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• pliang279 / sent_debias
  [ACL 2020] Towards Debiasing Sentence Representations
  ☆64Updated 2 years ago
• kanekomasahiro / evaluate_bias_in_mlm
  ☆13Updated 3 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆87Updated 3 years ago
• MichSchli / AVeriTeC
  ☆50Updated last month
• tommasoc80 / AbuseEval
  Data set for LREC 2020 paper "I Feel Offended, Don't Be Abusive!"
  ☆19Updated last year
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆22Updated 2 months ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆114Updated last year
• pliang279 / LM_bias
  [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models
  ☆60Updated 2 years ago
• ewsheng / controllable-nlg-biases
  Framework for controlling demographic biases in NLG (using adversarial prompts)
  ☆20Updated last year
• salesforce / QAFactEval
  ☆44Updated last year
• honglizhan / CovidET
  This repo contains the dataset for the EMNLP 2022 paper "Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts…
  ☆19Updated last year
• balevinstein / Probes
  ☆44Updated last year
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆136Updated 2 years ago
• thu-coai / DiaSafety
  This repo is for the paper: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark
  ☆24Updated 2 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆57Updated last year
• XuhuiZhou / Toxic_Debias
  code for our EACL 2021 paper: "Challenges in Automated Debiasing for Toxic Language Detection" by Xuhui Zhou, Maarten Sap, Swabha Swayamd…
  ☆19Updated 3 years ago
• exe1023 / DialEvalMetrics
  ☆62Updated 2 years ago