ChunyuanLI / Optimus
Optimus: the first large-scale pre-trained VAE language model
☆380Updated last year
Alternatives and similar repositories for Optimus:
Users that are interested in Optimus are comparing it to the libraries listed below
- A masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a…☆242Updated 3 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- Pytorch implementation of "A Probabilistic Formulation of Unsupervised Text Style Transfer" by He. et. al. at ICLR 2020☆163Updated 2 years ago
- ☆460Updated 3 years ago
- ☆176Updated 3 years ago
- DGMs for NLP. A roadmap.☆391Updated 2 years ago
- Understanding the Difficulty of Training Transformers☆328Updated 2 years ago
- Generative Flow based Sequence-to-Sequence Toolkit written in Python.☆243Updated 5 years ago
- Official Repository for "The Curious Case of Neural Text Degeneration"☆160Updated last year
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆326Updated last year
- Tracking the progress in non-autoregressive generation (translation, transcription, etc.)☆306Updated last year
- GeDi: Generative Discriminator Guided Sequence Generation☆208Updated 2 years ago
- ☆319Updated 2 years ago
- Implementation of the paper Tree Transformer☆213Updated 4 years ago
- Neural network parametrized objective to disentangle and transfer style and content in text☆139Updated 5 years ago
- ☆316Updated 3 years ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆178Updated last year
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆151Updated 2 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆250Updated 3 years ago
- Transformer-Based Conditioned Variational Autoencoder for Story Completion☆94Updated 4 years ago
- ☆213Updated 4 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆469Updated 11 months ago
- ☆207Updated 10 months ago
- PyTorch Re-Implementation of "Generating Sentences from a Continuous Space" by Bowman et al 2015 https://arxiv.org/abs/1511.06349☆590Updated last month
- Easily fine tune GPT-2 to fill in missing text☆196Updated 2 years ago
- This repo collects the articles for text attribute transfer☆245Updated 3 years ago
- ☆112Updated 3 years ago
- MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf☆287Updated 3 years ago
- PyTorch implementation of beam search decoding for seq2seq models☆338Updated 2 years ago
- Code for "Controllable Unsupervised Text Attribute Transfer via Editing Entangled Latent Representation" (NeurIPS 2019)☆127Updated 5 years ago