Alternatives and similar repositories for crows-pairs:

Users that are interested in crows-pairs are comparing it to the libraries listed below

• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆130Updated last month
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆70Updated 3 years ago
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆54Updated 3 years ago
• i-gallegos / Fair-LLM-Benchmark
  ☆124Updated last year
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆100Updated last year
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆72Updated 5 years ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆87Updated 2 weeks ago
• SALT-NLP / implicit-hate
  ☆38Updated last year
• pliang279 / sent_debias
  [ACL 2020] Towards Debiasing Sentence Representations
  ☆64Updated 2 years ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆87Updated 3 years ago
• balevinstein / Probes
  ☆46Updated last year
• moinnadeem / StereoSet
  StereoSet: Measuring stereotypical bias in pretrained language models
  ☆171Updated 2 years ago
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆22Updated 3 months ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• princeton-nlp / MABEL
  EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975
  ☆37Updated last year
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆113Updated last year
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• mcao516 / EntFA
  ☆25Updated 2 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆57Updated last year
• salesforce / QAFactEval
  ☆44Updated last year
• s-nlp / paradetox
  Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"
  ☆28Updated 3 months ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆194Updated 2 months ago
• thu-coai / DiaSafety
  This repo is for the paper: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark
  ☆24Updated 2 years ago
• tommasoc80 / AbuseEval
  Data set for LREC 2020 paper "I Feel Offended, Don't Be Abusive!"
  ☆18Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• kanekomasahiro / evaluate_bias_in_mlm
  ☆13Updated 3 years ago
• umanlp / RedditBias
  Code & Data for the paper "RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models"
  ☆24Updated 3 years ago
• shauli-ravfogel / nullspace_projection
  ☆87Updated 2 years ago
• AlexWan0 / rag-convincingness
  ☆25Updated 11 months ago
• tianlu-wang / Identifying-and-Mitigating-Spurious-Correlations-for-Improving-Robustness-in-NLP-Models
  NAACL 2022 Findings
  ☆15Updated 2 years ago