Alternatives and similar repositories for pretraining-with-nonsense:

Users that are interested in pretraining-with-nonsense are comparing it to the libraries listed below

• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆23Updated 2 years ago
• jungokasai / twist_decoding
  ☆29Updated 2 years ago
• McGill-NLP / latent-translation
  Code for the paper "Modelling Latent Translations for Cross-Lingual Transfer"
  ☆17Updated 3 years ago
• jiacheng-xu / sum-interpret
  Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)
  ☆13Updated 3 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• JunjieHu / amber
  Explicit Alignment Objectives for Multilingual Bidirectional Encoders
  ☆13Updated 4 years ago
• ShaojieJiang / tldr
  Source code repo for paper "TLDR: Token Loss Dynamic Reweighting for Reducing Repetitive Utterance Generation"
  ☆10Updated last year
• leo-liuzy / probe-across-time
  ☆22Updated 3 years ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• facebookresearch / CCQA
  CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training
  ☆32Updated 2 years ago
• timvieira / vocrf
  Variable-order CRFs with structure learning
  ☆16Updated 8 months ago
• allenai / faithful-nmn
  Evaluating and improving the faithfulness of the interpretations offered by Neural Module Networks
  ☆13Updated last year
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 2 years ago
• belindal / TaskBench500
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Updated 2 years ago
• facebookresearch / UNLU
  Code for the paper "UnNatural Language Inference" to appear at ACL 2021 (Long Paper)
  ☆36Updated 3 years ago
• dreasysnail / INSET
  INSET: Sentence Infilling with Inter-sentential Transformer
  ☆30Updated 4 years ago
• INK-USC / NExT
  Source Code for paper "Learning from Explanations with Neural Execution Tree", ICLR 2020
  ☆18Updated 4 years ago
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago
• jiacheng-xu / lattice-generation
  Code for Massive-scale Decoding for Text Generation using Lattices
  ☆44Updated 2 years ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆24Updated last year
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆43Updated 8 months ago
• alontalmor / LeapOfThought
  ☆49Updated last year
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• allenai / dream
  ☆23Updated 7 months ago
• lifu-tu / ENGINE
  ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
  ☆25Updated 4 years ago
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 3 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆26Updated 3 years ago
• Websail-NU / CODAH
  Repository for the CODAH dataset
  ☆22Updated 2 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago