Alternatives and similar repositories for evaluation-pipeline-2024

Users that are interested in evaluation-pipeline-2024 are comparing it to the libraries listed below

• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆76Updated last year
• lukemelas / mtob
  ☆34Updated 10 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated 11 months ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆66Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• krishnap25 / mauve-experiments
  ☆38Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• ghrua / NgramRes
  ☆21Updated 2 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆55Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆28Updated 3 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• ekinakyurek / lexical
  Paper: Lexicon Learning for Few-Shot Neural Sequence Modeling
  ☆16Updated 3 years ago
• jungokasai / deep-shallow
  ☆44Updated 4 years ago
• tommccoy1 / rnn-hierarchical-biases
  Code for "Does syntax need to grow on trees? Sources of inductive bias in sequence to sequence networks"
  ☆23Updated 5 years ago
• yanaiela / pararel
  ☆44Updated last year
• vipulraheja / iterater
  Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)
  ☆78Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆76Updated last year
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆24Updated 2 years ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 3 years ago
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 3 years ago
• princeton-nlp / ShortcutGrammar
  EMNLP 2022: Finding Dataset Shortcuts with Grammar Induction https://arxiv.org/abs/2210.11560
  ☆58Updated 2 months ago
• jacobandreas / geca
  ☆42Updated 4 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆41Updated 2 years ago
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆29Updated last year
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• katherinethai / par3
  ☆27Updated 5 months ago
• LEYADEV / Vocabulary-Transfer
  Implementation of the paper "Fine-Tuning Transformers: Vocabulary Transfer" https://arxiv.org/pdf/2112.14569.pdf
  ☆20Updated 3 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year