Alternatives and similar repositories for pretraining-with-nonsense

Users that are interested in pretraining-with-nonsense are comparing it to the libraries listed below

• jungokasai / twist_decoding
  ☆29Updated 3 years ago
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆24Updated 2 years ago
• allenai / dream
  ☆24Updated 11 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆24Updated 2 years ago
• facebookresearch / CCQA
  CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training
  ☆32Updated 3 years ago
• INK-USC / NExT
  Source Code for paper "Learning from Explanations with Neural Execution Tree", ICLR 2020
  ☆18Updated 4 years ago
• allenai / few_shot_explanations
  Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"
  ☆31Updated 2 years ago
• belindal / TaskBench500
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Updated 3 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• GChrysostomou / ood_faith
  ☆13Updated 2 years ago
• keyonvafa / sequential-rationales
  Rationales for Sequential Predictions
  ☆40Updated 3 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• leo-liuzy / probe-across-time
  ☆22Updated 3 years ago
• carolinlawrence / gradient-rollback
  Code for gradient rollback, which explains predictions of neural matrix factorization models, as for example used for knowledge base comp…
  ☆21Updated 4 years ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• renll / SparseLT
  [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing
  ☆14Updated 2 years ago
• facebookresearch / UNLU
  Code for the paper "UnNatural Language Inference" to appear at ACL 2021 (Long Paper)
  ☆36Updated 3 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆58Updated 2 years ago
• JunjieHu / amber
  Explicit Alignment Objectives for Multilingual Bidirectional Encoders
  ☆14Updated 4 years ago
• thunlp / CSS-LM
  CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models
  ☆13Updated 2 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 4 years ago
• dreasysnail / INSET
  INSET: Sentence Infilling with Inter-sentential Transformer
  ☆30Updated 4 years ago
• tatsu-lab / mlm_inductive_bias
  Code Release for "On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies"
  ☆16Updated 4 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• princeton-nlp / align-mlm
  ☆13Updated 2 years ago