allenai / flexLinks
Few-shot NLP benchmark for unified, rigorous eval
☆93Updated 3 years ago
Alternatives and similar repositories for flex
Users that are interested in flex are comparing it to the libraries listed below
Sorting:
- ReConsider is a re-ranking model that re-ranks the top-K (passage, answer-span) predictions of an Open-Domain QA Model like DPR (Karpukhi…☆49Updated 4 years ago
- Code and datasets for the EMNLP 2020 paper "Calibration of Pre-trained Transformers"☆61Updated 2 years ago
- EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation☆98Updated 2 years ago
- The official implementation of ACL 2020, "Logic-Guided Data Augmentation and Regularization for Consistent Question Answering".☆71Updated last year
- ☆49Updated 2 years ago
- We are creating a challenging new benchmark MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models. Retrieval quest…☆31Updated 5 years ago
- Code Repo for the ACL21 paper "Common Sense Beyond English: Evaluating and Improving Multilingual LMs for Commonsense Reasoning"☆23Updated 4 years ago
- ☆46Updated 5 years ago
- [ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling☆72Updated 3 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆104Updated 4 years ago
- EMNLP 2021: Single-dataset Experts for Multi-dataset Question-Answering☆68Updated 4 years ago
- The accompanying code for "Injecting Numerical Reasoning Skills into Language Models" (Mor Geva*, Ankit Gupta* and Jonathan Berant, ACL 2…☆89Updated last year
- Code and Data for our EMNLP 2020 paper titled 'Learning to Explain: Datasets and Models for Identifying Valid Reasoning Chains in Multiho…☆28Updated 3 years ago
- This repository contains the code for "How many data points is a prompt worth?"☆48Updated 4 years ago
- Implementation of NeurIPS 20 paper: Latent Template Induction with Gumbel-CRFs☆56Updated 5 years ago
- ☆49Updated 2 years ago
- ☆68Updated 8 months ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Updated 3 months ago
- [NAACL 2021] Factual Probing Is [MASK]: Learning vs. Learning to Recall https://arxiv.org/abs/2104.05240☆168Updated 3 years ago
- Code for papers "A Surprisingly Robust Trick for Winograd Schema Challenge" and "WikiCREM: A Large Unsupervised Corpus for Coreference Re…☆71Updated 3 years ago
- A BART version of an open-domain QA model in a closed-book setup☆119Updated 5 years ago
- Language model Prompt And Query Archive☆160Updated 4 years ago
- Code and data for "Retrieval Enhanced Model for Commonsense Generation" (ACL-IJCNLP 2021).☆29Updated 4 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆64Updated 4 years ago
- Code for ModularQA☆28Updated 4 years ago
- ☆58Updated 3 years ago
- Hyperparameter Search for AllenNLP☆140Updated 10 months ago
- ☆92Updated 4 years ago
- This repository maintains the QAConv dataset, a question-answering dataset on informative conversations including business emails, panel …☆84Updated last year
- EMNLP 2021 Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections☆52Updated 4 years ago