ChunyuanLI / Optimus
Optimus: the first large-scale pre-trained VAE language model
☆384Updated last year
Alternatives and similar repositories for Optimus:
Users that are interested in Optimus are comparing it to the libraries listed below
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- A masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a…☆242Updated 3 years ago
- ☆177Updated 3 years ago
- Pytorch implementation of "A Probabilistic Formulation of Unsupervised Text Style Transfer" by He. et. al. at ICLR 2020☆163Updated 2 years ago
- Generative Flow based Sequence-to-Sequence Toolkit written in Python.☆244Updated 5 years ago
- GeDi: Generative Discriminator Guided Sequence Generation☆208Updated 2 years ago
- ☆321Updated 2 years ago
- ☆462Updated 3 years ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆178Updated last year
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆327Updated last year
- ☆206Updated 11 months ago
- Tracking the progress in non-autoregressive generation (translation, transcription, etc.)☆307Updated 2 years ago
- DGMs for NLP. A roadmap.☆389Updated 2 years ago
- Code associated with the Don't Stop Pretraining ACL 2020 paper☆529Updated 3 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆250Updated 3 years ago
- Implementation of the paper Tree Transformer☆214Updated 4 years ago
- PyTorch Re-Implementation of "Generating Sentences from a Continuous Space" by Bowman et al 2015 https://arxiv.org/abs/1511.06349☆591Updated 2 months ago
- The code of ACL 2020 paper "You Impress Me: Dialogue Generation via Mutual Persona Perception"☆307Updated last year
- Code for "Controllable Unsupervised Text Attribute Transfer via Editing Entangled Latent Representation" (NeurIPS 2019)☆127Updated 5 years ago
- Understanding the Difficulty of Training Transformers☆328Updated 2 years ago
- ☆362Updated 2 years ago
- ☆318Updated 3 years ago
- Easily fine tune GPT-2 to fill in missing text☆198Updated 2 years ago
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆153Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆471Updated last year
- Transformer-Based Conditioned Variational Autoencoder for Story Completion☆94Updated 4 years ago
- PyTorch implementation of beam search decoding for seq2seq models☆337Updated 2 years ago
- Official Repository for "The Curious Case of Neural Text Degeneration"☆161Updated last year
- ☆163Updated 2 years ago
- This repo collects the articles for text attribute transfer☆244Updated 3 years ago