facebookresearch / irt-leaderboard

Leaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and subjects (NLP models). Rather than replace leaderboards, we advocate a re-imagining so that they better highlight if and where progress is made. Buildi…
16Updated 2 years ago

Related projects

Alternatives and complementary repositories for irt-leaderboard