facebookresearch / irt-leaderboardLinks
Leaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and subjects (NLP models). Rather than replace leaderboards, we advocate a re-imagining so that they better highlight if and where progress is made. Buildi…
☆18Updated 3 years ago
Alternatives and similar repositories for irt-leaderboard
Users that are interested in irt-leaderboard are comparing it to the libraries listed below
Sorting:
- Hyperparameter Search for AllenNLP☆139Updated 7 months ago
- ☆75Updated 4 years ago
- Python code for training models in the ACL paper, "Simple and Effective Paraphrastic Similarity from Parallel Translations".☆22Updated 6 years ago
- Replication code for "With Little Power Comes Great Responsibility"☆39Updated 4 years ago
- ☆25Updated 5 years ago
- Zero-Shot Open Entity Typing as Type-Compatible Grounding, EMNLP'18.☆42Updated 5 years ago
- Implementation of Nested Named Entity Recognition using Flair☆24Updated 3 years ago
- Statistics on multilingual datasets☆17Updated 3 years ago
- Dataset and code of our EMNLP 2019 paper "Multilingual and Multi-Aspect Hate Speech Analysis"☆57Updated 10 months ago
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆31Updated 5 years ago
- Few-shot NLP benchmark for unified, rigorous eval☆93Updated 3 years ago
- Participant Kit for the TextGraphs-15 Shared Task on Explanation Regeneration☆19Updated 3 years ago
- Code for the paper "Latent Relation Language Models" at AAAI-20.☆41Updated 2 weeks ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 5 years ago
- Hyperparameter search for AllenNLP - powered by Ray TUNE☆28Updated 7 months ago
- Automatically detect errors in annotated corpora.☆47Updated 2 years ago
- ☆27Updated 2 years ago
- Code for bidirectional sequence generation (BiSon) for generating from BERT pre-trained models.☆51Updated 5 years ago
- A program to choose transfer languages for cross-lingual learning☆72Updated 2 weeks ago
- A Mechanical Turk Interface (amti) 🤖☆56Updated last year
- Making a bridge between NLP models and Brain data☆18Updated 5 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 5 years ago
- ☆13Updated 4 years ago
- Cross-lingual TRansfer Evaluation of Multilingual Encoders (XTREME)☆22Updated 5 years ago
- Relevant code for the "Show Your Work" paper, EMNLP 2019.☆18Updated 6 years ago
- Code for "Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?"☆45Updated last year
- pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference☆62Updated 2 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆88Updated 4 months ago
- Code for our ACL '20 paper "Representation Engineering with Natural Language Explanations"☆29Updated 5 years ago
- Code for Massive-scale Decoding for Text Generation using Lattices☆44Updated 3 years ago