Alternatives and similar repositories for pretraining-with-nonsense

Users that are interested in pretraining-with-nonsense are comparing it to the libraries listed below

• jungokasai / twist_decoding
  ☆29Updated 3 years ago
• INK-USC / NExT
  Source Code for paper "Learning from Explanations with Neural Execution Tree", ICLR 2020
  ☆18Updated 4 years ago
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆24Updated 3 years ago
• facebookresearch / CCQA
  CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training
  ☆32Updated 3 years ago
• allenai / dream
  ☆24Updated 11 months ago
• belindal / TaskBench500
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Updated 3 years ago
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆25Updated 2 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• leo-liuzy / probe-across-time
  ☆22Updated 3 years ago
• yandex-research / graph-glove
  PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"
  ☆41Updated 4 years ago
• JunjieHu / amber
  Explicit Alignment Objectives for Multilingual Bidirectional Encoders
  ☆14Updated 4 years ago
• facebookresearch / UNLU
  Code for the paper "UnNatural Language Inference" to appear at ACL 2021 (Long Paper)
  ☆36Updated 3 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• jiacheng-xu / lattice-generation
  Code for Massive-scale Decoding for Text Generation using Lattices
  ☆44Updated 3 years ago
• keyonvafa / sequential-rationales
  Rationales for Sequential Predictions
  ☆40Updated 3 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• dreasysnail / INSET
  INSET: Sentence Infilling with Inter-sentential Transformer
  ☆30Updated 4 years ago
• princeton-nlp / align-mlm
  ☆13Updated 2 years ago
• allenai / few_shot_explanations
  Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"
  ☆31Updated 2 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• GChrysostomou / ood_faith
  ☆13Updated 2 years ago
• tatsu-lab / mlm_inductive_bias
  Code Release for "On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies"
  ☆16Updated 4 years ago
• ShaojieJiang / tldr
  Source code repo for paper "TLDR: Token Loss Dynamic Reweighting for Reducing Repetitive Utterance Generation"
  ☆10Updated 2 years ago
• galsang / trees_from_transformers
  Official code for the ICLR 2020 paper 'ARE PPE-TRAINED LANGUAGE MODELS AWARE OF PHRASES? SIMPLE BUT STRONG BASELINES FOR GRAMMAR INDCUTIO…
  ☆30Updated 2 years ago
• jungokasai / deep-shallow
  ☆44Updated 4 years ago
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• intersun / CoDIR
  Code for EMNLP 2020 paper CoDIR
  ☆41Updated 2 years ago