ConnorJL / GPT2
An implementation of training for GPT2, supports TPUs
☆1,424Updated 2 years ago
Alternatives and similar repositories for GPT2:
Users that are interested in GPT2 are comparing it to the libraries listed below
- GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型☆1,713Updated last year
- Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation☆994Updated 5 years ago
- Conditional Transformer Language Model for Controllable Generation☆1,884Updated last week
- Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://…☆2,388Updated 3 years ago
- Single Headed Attention RNN - "Stop thinking with your head"☆1,183Updated 3 years ago
- ✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝☆371Updated 3 years ago
- 🦄 State-of-the-Art Conversational AI with Transfer Learning☆1,749Updated last year
- Dataset of GPT-2 outputs for research in detection, biases, and more☆1,978Updated last year
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,208Updated 6 years ago
- The Natural Language Decathlon: A Multitask Challenge for NLP☆2,349Updated last week
- Chinese Pre-Trained Language Models (CPM-LM) Version-I☆1,585Updated 2 years ago
- Code for the paper "Language Models are Unsupervised Multitask Learners"☆1,146Updated 2 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,189Updated last year
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,267Updated 2 years ago
- 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆1,507Updated 3 years ago
- Neural machine translation and sequence learning using TensorFlow☆1,468Updated last year
- Simple XLNet implementation with Pytorch Wrapper☆581Updated 5 years ago
- Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CAS…☆745Updated 3 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,906Updated 2 years ago
- An optimizer that trains as fast as Adam and as good as SGD.☆2,915Updated last year
- NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego☆1,453Updated last year
- Lingvo☆2,837Updated last week
- Phrase-Based & Neural Unsupervised Machine Translation☆1,504Updated 3 years ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,569Updated 4 years ago
- Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts☆3,404Updated 2 years ago
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,144Updated last year
- ☆3,645Updated 2 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,353Updated last year
- OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0☆262Updated 2 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,119Updated 2 years ago