bigscience-workshop / evaluation

Related projects ⓘ

Alternatives and complementary repositories for evaluation

• jwieting / paraphrastic-representations-at-scale
  ☆73Updated 3 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆26Updated 3 years ago
• leo-liuzy / probe-across-time
  ☆22Updated 3 years ago
• AkariAsai / XORQA
  This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".
  ☆79Updated 3 years ago
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆84Updated 2 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 2 years ago
• alexa / ramen
  A software for transferring pre-trained English models to foreign languages
  ☆18Updated last year
• tingofurro / keep_it_simple
  Codebase, data and models for the Keep it Simple paper at ACL2021
  ☆36Updated last year
• facebookresearch / asset
  A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
  ☆54Updated 2 years ago
• Kaleidophon / awesome-experimental-standards-deep-learning
  Repository collecting resources and best practices to improve experimental rigour in deep learning research.
  ☆27Updated last year
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆75Updated 3 years ago
• dallascard / NLP-power-analysis
  ☆38Updated 4 years ago
• iesl / interactive_LM
  ☆20Updated last year
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆134Updated 4 years ago
• alontalmor / oLMpics
  ☆46Updated 4 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆139Updated 2 years ago
• shmsw25 / bart-closed-book-qa
  A BART version of an open-domain QA model in a closed-book setup
  ☆119Updated 4 years ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆61Updated 2 years ago
• jacobandreas / geca
  ☆42Updated 3 years ago
• danieldeutsch / repro
  Repro is a library for easily running code from published papers via Docker.
  ☆40Updated last year
• martiansideofthemoon / hurdles-longform-qa
  Official repository with code and data accompanying the NAACL 2021 paper "Hurdles to Progress in Long-form Question Answering" (https://a…
  ☆46Updated 2 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 3 years ago
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• jayded / eraserbenchmark
  A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/
  ☆97Updated 2 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆55Updated 2 years ago
• thevasudevgupta / transformers-adapters
  This repositary hosts my experiments for the project, I did with OffNote Labs.
  ☆11Updated 3 years ago
• facebookresearch / QA-Overlap
  Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"
  ☆66Updated 3 years ago
• danielvarab / massive-summ
  ☆27Updated last year
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆47Updated last year