facebookresearch / irt-leaderboard
Leaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and subjects (NLP models). Rather than replace leaderboards, we advocate a re-imagining so that they better highlight if and where progress is made. Buildi…
☆16Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for irt-leaderboard
- ☆18Updated 5 years ago
- ☆38Updated 4 years ago
- ☆23Updated 4 years ago
- Bayesian Assessment of Hypotheses☆24Updated last year
- ☆17Updated last year
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆31Updated 4 years ago
- Code for our ACL '20 paper "Representation Engineering with Natural Language Explanations"☆29Updated 4 years ago
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16Updated 2 years ago
- codebase for the Text-based NP Enrichment (TNE) paper☆19Updated 8 months ago
- Multilingual Compositional Wikidata Questions (MCWQ)☆18Updated last year
- Converter from UD-trees to BART representation☆36Updated 8 months ago
- ☆12Updated 3 years ago
- Variable-order CRFs with structure learning☆16Updated 3 months ago
- ☆16Updated 5 years ago
- ☆29Updated last year
- ☆12Updated 5 years ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- Relevant code for the "Show Your Work" paper, EMNLP 2019.☆18Updated 5 years ago
- ☆31Updated last year
- Making a bridge between NLP models and Brain data☆18Updated 4 years ago
- Chu-Lui-Edmonds decoding extracted from TurboParser☆13Updated 7 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆18Updated 4 years ago
- Post-editing Datasets by Rakuten (PEDRa)☆14Updated 3 years ago
- Pre-training character n-gram embeddings☆23Updated last year
- ☆17Updated last year
- A generic library for crafting adversarial NLP examples - WIP☆40Updated 6 years ago
- ☆22Updated 2 years ago
- ☆73Updated 3 years ago