Alternatives and similar repositories for eval-framework

Users that are interested in eval-framework are comparing it to the libraries listed below

• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆54Updated 2 years ago
• allenai / fermi
  ☆30Updated 3 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆24Updated 3 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 3 years ago
• allenai / dream
  ☆24Updated last year
• allenai / openpi-dataset
  OpenPI dataset for tracking entities in open domain procedural text
  ☆24Updated last year
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Updated last year
• alontalmor / LeapOfThought
  ☆49Updated 2 years ago
• google-deepmind / emergent_in_context_learning
  ☆84Updated last year
• frankaging / Reason-SCAN
  ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…
  ☆19Updated 3 years ago
• gucci-j / light-transformer-emnlp2021
  EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
  ☆34Updated 3 years ago
• allenai / qasc
  Repository for the Question Answering via Sentence Composition (QASC) dataset
  ☆56Updated 2 years ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• rowanz / piglet
  PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]
  ☆57Updated 3 years ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆67Updated 2 years ago
• keep-smile-001 / opentqa
  opentqa is a open framework of the textbook question answering, which includes xtqa, mcan, cmr, mfb, mutan.
  ☆11Updated 4 years ago
• rowanz / turingadvice
  Evaluating Machines by their Real-World Language Use
  ☆33Updated 2 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• mohsenfayyaz / GlobEnc
  [NAACL 2022] GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers
  ☆21Updated 2 years ago
• allenai / sherlock
  Code, data, models for the Sherlock corpus
  ☆58Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆54Updated 4 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 2 years ago
• easonnie / ChaosNLI
  [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data
  ☆40Updated 3 years ago
• anthonywchen / MOCHA
  Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".
  ☆16Updated 3 years ago
• allenai / interscript
  The InterScript dataset contains interactive user feedback on scripts generated by a T5-XXL model.
  ☆12Updated 3 years ago
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• neubig / coderx
  A highly sophisticated sequence-to-sequence model for code generation
  ☆40Updated 4 years ago
• microsoft / DFOL-VQA
  Differentiable First-Order Logic Reasoning for Visual Question Answering
  ☆41Updated 4 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago