Alternatives and similar repositories for crows-pairs:

Users that are interested in crows-pairs are comparing it to the libraries listed below

• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆134Updated 3 months ago
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆103Updated last year
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆54Updated 3 years ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆77Updated 4 years ago
• i-gallegos / Fair-LLM-Benchmark
  ☆127Updated last year
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆74Updated 5 years ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆89Updated last month
• moinnadeem / StereoSet
  StereoSet: Measuring stereotypical bias in pretrained language models
  ☆177Updated 2 years ago
• pliang279 / sent_debias
  [ACL 2020] Towards Debiasing Sentence Representations
  ☆64Updated 2 years ago
• SALT-NLP / implicit-hate
  ☆38Updated last year
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆87Updated 3 years ago
• allenai / unqover
  UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)
  ☆20Updated 3 years ago
• MichSchli / AVeriTeC
  ☆54Updated 3 months ago
• acl-org / responsibleNLPresearch
  templates and other documents regarding responsible NLP research
  ☆66Updated last year
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆196Updated 3 months ago
• kanekomasahiro / evaluate_bias_in_mlm
  ☆13Updated 3 years ago
• princeton-nlp / MABEL
  EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975
  ☆37Updated last year
• tommasoc80 / AbuseEval
  Data set for LREC 2020 paper "I Feel Offended, Don't Be Abusive!"
  ☆18Updated last year
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆114Updated last year
• mcao516 / EntFA
  ☆25Updated 2 years ago
• salesforce / QAFactEval
  ☆44Updated last year
• beinborn / relative_importance
  ☆16Updated 3 years ago
• pliang279 / LM_bias
  [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models
  ☆60Updated 2 years ago
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆22Updated last week
• balevinstein / Probes
  ☆47Updated last year
• tatsu-lab / opinions_qa
  ☆104Updated 10 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆58Updated last year
• ml-research / MoRT_NMI
  ☆18Updated 3 years ago