Alternatives and similar repositories for Mephisto:

Users that are interested in Mephisto are comparing it to the libraries listed below

• facebookresearch / vizseq
  An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
  ☆444Updated 3 months ago
• microsoft / adaptive-testing
  Find and fix bugs in natural language machine learning models using adaptive testing.
  ☆181Updated 9 months ago
• robustness-gym / robustness-gym
  Robustness Gym is an evaluation toolkit for machine learning.
  ☆442Updated 2 years ago
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆568Updated this week
• stanfordnlp / chirpycardinal
  Stanford's Alexa Prize socialbot
  ☆133Updated last year
• allenai / tango
  Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.
  ☆538Updated 8 months ago
• facebookresearch / PAQ
  Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"
  ☆202Updated 3 years ago
• google-research-datasets / tydiqa
  TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …
  ☆300Updated 4 years ago
• GEM-benchmark / NL-Augmenter
  NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations
  ☆780Updated 8 months ago
• facebookresearch / anli
  Adversarial Natural Language Inference Benchmark
  ☆395Updated 2 years ago
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆461Updated 2 years ago
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆311Updated last year
• stanford-crfm / mistral
  Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging F…
  ☆569Updated last year
• neulab / ExplainaBoard
  Interpretable Evaluation for AI Systems
  ☆361Updated last year
• facebookresearch / KILT
  Library for Knowledge Intensive Language Tasks
  ☆927Updated 2 years ago
• allenai / unifiedqa
  UnifiedQA: Crossing Format Boundaries With a Single QA System
  ☆431Updated 2 years ago
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆124Updated 3 years ago
• zeno-ml / zeno
  AI Data Management & Evaluation Platform
  ☆215Updated last year
• bhoov / exbert
  A Visual Analysis Tool to Explore Learned Representations in Transformers Models
  ☆587Updated last year
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆612Updated 2 years ago
• robustness-gym / summvis
  SummVis is an interactive visualization tool for text summarization.
  ☆252Updated 2 years ago
• PAIR-code / knowyourdata
  A tool to help researchers and product teams understand datasets with the goal of improving data quality, and mitigating fairness and bia…
  ☆288Updated 2 years ago
• apple / ml-mkqa
  We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …
  ☆171Updated 2 years ago
• golsun / DialogRPT
  EMNLP 2020: "Dialogue Response Ranking Training with Large-Scale Human Feedback Data"
  ☆337Updated 3 months ago
• g8a9 / ferret
  A python package for benchmarking interpretability techniques on Transformers.
  ☆213Updated 4 months ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆194Updated 2 months ago
• google-research / longt5
  ☆182Updated last year
• google-deepmind / xmanager
  A platform for managing machine learning experiments
  ☆838Updated 3 weeks ago
• EleutherAI / pyfra
  Python Research Framework
  ☆106Updated 2 years ago
• allenai / allennlp-models
  Officially supported AllenNLP models
  ☆537Updated 2 years ago