apple / ml-mkqa
We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically diverse languages (260k question-answer pairs in total). The goal of this dataset is to provide a challenging benchmark for question answering quality across a wide set of languages. Please refer to our paper f…
☆171Updated 2 years ago
Alternatives and similar repositories for ml-mkqa:
Users that are interested in ml-mkqa are comparing it to the libraries listed below
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- ☆186Updated 3 years ago
- Open-Domain Question Answering Goes Conversational via Question Rewriting☆147Updated 2 years ago
- [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction☆120Updated 3 years ago
- An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"☆117Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆187Updated 3 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆200Updated last year
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …☆299Updated 4 years ago
- Multilingual abstractive summarization dataset extracted from WikiHow.☆85Updated 3 years ago
- ☆157Updated 5 years ago
- Code to reproduce the experiments from the paper.☆101Updated last year
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆291Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆97Updated last month
- A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations☆54Updated 2 years ago
- MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension and question answerin…☆212Updated last year
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆140Updated 2 years ago
- cLang-8 is a dataset for grammatical error correction.☆103Updated 2 years ago
- QED: A Framework and Dataset for Explanations in Question Answering☆115Updated 3 years ago
- Question-answers, collected from Google☆125Updated 3 years ago
- ☆96Updated 2 years ago
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.☆102Updated 2 years ago
- A BART version of an open-domain QA model in a closed-book setup☆120Updated 4 years ago
- The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization☆154Updated 2 years ago
- Search Engines with Autoregressive Language models☆281Updated last year
- A multilingual version of MS MARCO passage ranking dataset☆143Updated last year
- MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, …☆123Updated 3 years ago
- Code from the paper "What do Models Learn from Question Answering Datasets?" (EMNLP 2020)☆54Updated 4 years ago
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆73Updated 2 years ago
- a tool for calcualting character n-gram F score☆68Updated last year
- Interpretable Evaluation for (Almost) All NLP Tasks☆195Updated 2 years ago