Alternatives and similar repositories for pretraining-with-nonsense:

Users that are interested in pretraining-with-nonsense are comparing it to the libraries listed below

• jungokasai / twist_decoding
  ☆28Updated 2 years ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated last year
• McGill-NLP / latent-translation
  Code for the paper "Modelling Latent Translations for Cross-Lingual Transfer"
  ☆17Updated 3 years ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆23Updated 2 years ago
• leo-liuzy / probe-across-time
  ☆22Updated 3 years ago
• timvieira / vocrf
  Variable-order CRFs with structure learning
  ☆15Updated 6 months ago
• JunjieHu / amber
  Explicit Alignment Objectives for Multilingual Bidirectional Encoders
  ☆13Updated 3 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆26Updated 3 years ago
• facebookresearch / UNLU
  Code for the paper "UnNatural Language Inference" to appear at ACL 2021 (Long Paper)
  ☆36Updated 3 years ago
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago
• belindal / TaskBench500
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Updated 2 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 2 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated last year
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆26Updated last year
• jiacheng-xu / lattice-generation
  Code for Massive-scale Decoding for Text Generation using Lattices
  ☆45Updated 2 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆11Updated 4 years ago
• allenai / few_shot_explanations
  Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"
  ☆31Updated last year
• allenai / dream
  ☆23Updated 5 months ago
• jiacheng-xu / sum-interpret
  Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)
  ☆13Updated 3 years ago
• INK-USC / NExT
  Source Code for paper "Learning from Explanations with Neural Execution Tree", ICLR 2020
  ☆18Updated 3 years ago
• lifu-tu / ENGINE
  ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
  ☆25Updated 4 years ago
• galsang / trees_from_transformers
  Official code for the ICLR 2020 paper 'ARE PPE-TRAINED LANGUAGE MODELS AWARE OF PHRASES? SIMPLE BUT STRONG BASELINES FOR GRAMMAR INDCUTIO…
  ☆30Updated last year
• machelreid / editpro
  Learning to Model Editing Processes
  ☆26Updated 2 years ago
• alon-albalak / TLiDB
  Transfer Learning in Dialogue Benchmarking Toolkit
  ☆14Updated last year
• ShaojieJiang / tldr
  Source code repo for paper "TLDR: Token Loss Dynamic Reweighting for Reducing Repetitive Utterance Generation"
  ☆10Updated last year
• lipiji / vae-salience
  "Salience Estimation via Variational Auto-Encoders for Multi-Document Summarization"
  ☆9Updated 6 years ago
• dreasysnail / INSET
  INSET: Sentence Infilling with Inter-sentential Transformer
  ☆30Updated 4 years ago
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated 2 years ago