ConnorJL / GPT2
An implementation of training for GPT2, supports TPUs
☆1,425Updated 2 years ago
Alternatives and similar repositories for GPT2:
Users that are interested in GPT2 are comparing it to the libraries listed below
- Conditional Transformer Language Model for Controllable Generation☆1,879Updated 3 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,183Updated last year
- Single Headed Attention RNN - "Stop thinking with your head"☆1,181Updated 3 years ago
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,268Updated last year
- Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://…☆2,388Updated 3 years ago
- Lingvo☆2,833Updated last week
- The Natural Language Decathlon: A Multitask Challenge for NLP☆2,347Updated last year
- 🦄 State-of-the-Art Conversational AI with Transfer Learning☆1,749Updated last year
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,196Updated 6 years ago
- ☆3,639Updated 2 years ago
- ✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝☆371Updated 3 years ago
- Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation☆989Updated 5 years ago
- Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.☆730Updated 2 years ago
- GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型☆1,711Updated last year
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,141Updated last year
- NLP made easy☆2,558Updated last year
- Code for the paper "Language Models are Unsupervised Multitask Learners"☆1,146Updated 2 years ago
- 🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLP☆1,193Updated last year
- Open Source Neural Machine Translation and (Large) Language Models in PyTorch☆6,850Updated 2 weeks ago
- Dataset of GPT-2 outputs for research in detection, biases, and more☆1,969Updated last year
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,562Updated 4 years ago
- Basic Utilities for PyTorch Natural Language Processing (NLP)☆2,222Updated last year
- OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0☆263Updated 2 years ago
- An open clone of the GPT-2 WebText dataset by OpenAI. Still WIP.☆389Updated 11 months ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,958Updated 2 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,903Updated 2 years ago
- Neural machine translation and sequence learning using TensorFlow☆1,467Updated last year
- 🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP☆12,615Updated last year
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,350Updated last year
- 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆1,508Updated 3 years ago