Alternatives and similar repositories for BBQ:

Users that are interested in BBQ are comparing it to the libraries listed below

• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆77Updated 4 years ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆115Updated last year
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆135Updated 3 months ago
• i-gallegos / Fair-LLM-Benchmark
  ☆128Updated last year
• allenai / unqover
  UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)
  ☆22Updated 3 years ago
• balevinstein / Probes
  ☆47Updated last year
• tatsu-lab / opinions_qa
  ☆104Updated 11 months ago
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆74Updated 5 years ago
• AlexWan0 / rag-convincingness
  ☆25Updated last year
• genglinliu / UnknownBench
  Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge
  ☆13Updated last year
• joeljang / knowledge-unlearning
  [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models
  ☆80Updated 6 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆71Updated 3 weeks ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆52Updated 4 months ago
• SALT-NLP / chain-of-thought-bias
  ☆25Updated 6 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆58Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆95Updated last month
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆90Updated 2 months ago
• zepingyu0512 / neuron-attribution
  code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models
  ☆29Updated 4 months ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆88Updated 3 years ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆114Updated last year
• d223302 / LLM-Evaluation
  Can Large Language Models Be an Alternative to Human Evaluations?
  ☆9Updated last year
• salesforce / QAFactEval
  ☆45Updated 2 years ago
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆107Updated 6 months ago
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆91Updated last year
• tsor13 / kaleido
  ☆22Updated last year
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆34Updated 2 months ago
• roeehendel / icl_task_vectors
  ☆93Updated last year