facebookresearch / irt-leaderboard

Leaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and subjects (NLP models). Rather than replace leaderboards, we advocate a re-imagining so that they better highlight if and where progress is made. Buildi…
17Updated 2 years ago

Alternatives and similar repositories for irt-leaderboard:

Users that are interested in irt-leaderboard are comparing it to the libraries listed below