ConnorJL / GPT2
An implementation of training for GPT2, supports TPUs
☆1,424Updated 2 years ago
Alternatives and similar repositories for GPT2:
Users that are interested in GPT2 are comparing it to the libraries listed below
- GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型☆1,714Updated last year
- NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego☆1,454Updated last year
- Dataset of GPT-2 outputs for research in detection, biases, and more☆1,975Updated last year
- Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://…☆2,388Updated 3 years ago
- Lingvo☆2,837Updated this week
- ✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝☆371Updated 3 years ago
- Conditional Transformer Language Model for Controllable Generation☆1,882Updated 3 years ago
- Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts☆3,405Updated 2 years ago
- Code for the paper "Language Models are Unsupervised Multitask Learners"☆1,146Updated 2 years ago
- Single Headed Attention RNN - "Stop thinking with your head"☆1,183Updated 3 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,187Updated last year
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,205Updated 6 years ago
- Phrase-Based & Neural Unsupervised Machine Translation☆1,503Updated 3 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,905Updated 2 years ago
- Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN☆964Updated 6 years ago
- Neural machine translation and sequence learning using TensorFlow☆1,469Updated last year
- repo for interactive article☆456Updated 3 years ago
- TensorFlow Neural Machine Translation Tutorial☆6,419Updated 2 years ago
- 🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLP☆1,194Updated last year
- Code for Defending Against Neural Fake News, https://rowanzellers.com/grover/☆921Updated last year
- 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆1,507Updated 3 years ago
- OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0☆262Updated 2 years ago
- An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group☆709Updated 2 years ago
- Chinese Pre-Trained Language Models (CPM-LM) Version-I☆1,586Updated 2 years ago
- An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.☆389Updated last year
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,568Updated 4 years ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,421Updated 3 years ago
- Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation☆990Updated 5 years ago
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,143Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit☆3,740Updated 3 years ago