facebookresearch / irt-leaderboardLinks
Leaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and subjects (NLP models). Rather than replace leaderboards, we advocate a re-imagining so that they better highlight if and where progress is made. Buildi…
☆17Updated 3 years ago
Alternatives and similar repositories for irt-leaderboard
Users that are interested in irt-leaderboard are comparing it to the libraries listed below
Sorting:
- ☆39Updated 4 years ago
- ☆24Updated 5 years ago
- Bayesian Assessment of Hypotheses☆24Updated last year
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆31Updated 5 years ago
- Author implementation of the paper "Don’t paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing"☆20Updated 4 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- Cross-lingual TRansfer Evaluation of Multilingual Encoders (XTREME)☆22Updated 5 years ago
- Python code for training models in the ACL paper, "Simple and Effective Paraphrastic Similarity from Parallel Translations".☆22Updated 5 years ago
- ☆13Updated 4 years ago
- Code for our ACL '20 paper "Representation Engineering with Natural Language Explanations"☆29Updated 4 years ago
- ☆19Updated 5 years ago
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20Updated 3 years ago
- Frame-Semantic and PropBank Semantic Role Labeling with Syntactic Scaffolding.☆50Updated 3 years ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- Zero-Shot Open Entity Typing as Type-Compatible Grounding, EMNLP'18.☆42Updated 5 years ago
- ☆12Updated 4 years ago
- Defeasible Natural Language Inference☆12Updated 4 years ago
- Workshop Home Page for Benchmarking: Past, Present and Future☆35Updated 3 years ago
- Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"☆31Updated 2 years ago
- Chu-Lui-Edmonds decoding extracted from TurboParser☆13Updated 8 years ago
- ☆16Updated 6 years ago
- ☆10Updated 8 years ago
- Making a bridge between NLP models and Brain data☆18Updated 5 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated 2 years ago
- SUM-QE, a BERT-based Summary Quality Estimation Model☆21Updated last year
- ☆24Updated 4 years ago
- Implementation of Nested Named Entity Recognition using Flair☆24Updated 3 years ago
- ☆17Updated 2 years ago
- Code for ModularQA☆28Updated 3 years ago
- This repository includes the masking vocabulary used in the ICLR 2021 spotlight PMI-Masking paper☆14Updated 3 years ago