google-research-datasets / seegull
SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 different geo-political regions across 6 continents, as well as state-level identities within the US and India.
☆33Updated last year
Alternatives and similar repositories for seegull:
Users that are interested in seegull are comparing it to the libraries listed below
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆67Updated last year
- Resources for cultural NLP research☆86Updated last month
- ☆65Updated last year
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 9 months ago
- A curated list of research papers and resources on Cultural LLM.☆39Updated 5 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Repository for research in the field of Responsible NLP at Meta.☆196Updated 3 months ago
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆71Updated 6 months ago
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 2 years ago
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆62Updated 2 years ago
- FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists☆28Updated 3 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆71Updated 4 years ago
- ☆24Updated 2 months ago
- A package dedicated for running benchmark agreement testing☆16Updated 3 months ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆22Updated last year
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆83Updated 6 months ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- ☆38Updated 10 months ago
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆80Updated 10 months ago
- ☆14Updated 10 months ago
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆26Updated 5 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆40Updated 3 months ago
- ☆31Updated 5 months ago
- Apps built using Inspired Cognition's Critique.☆58Updated 2 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 10 months ago
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16Updated 2 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆43Updated 6 months ago
- Codebase, data and models for the SummaC paper in TACL☆87Updated last month