nyu-mll / BBQ
Repository for the Bias Benchmark for QA dataset.
☆113Updated last year
Alternatives and similar repositories for BBQ:
Users that are interested in BBQ are comparing it to the libraries listed below
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆79Updated 4 years ago
- This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…☆117Updated last year
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆137Updated 4 months ago
- ☆106Updated 11 months ago
- ☆48Updated last year
- ☆131Updated last year
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆22Updated 3 years ago
- Data for evaluating gender bias in coreference resolution systems.☆75Updated 5 years ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆96Updated last month
- Inspecting and Editing Knowledge Representations in Language Models☆115Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆58Updated last year
- ☆26Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆22Updated last month
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆71Updated last month
- ☆72Updated 4 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆53Updated 4 months ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- Code and data for Marked Personas (ACL 2023)☆23Updated last year
- [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models☆80Updated 7 months ago
- Repository for research in the field of Responsible NLP at Meta.☆199Updated 4 months ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆52Updated 8 months ago
- ☆36Updated 2 years ago
- ☆41Updated 11 months ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆68Updated 2 years ago
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆97Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆91Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆143Updated 11 months ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆108Updated last year