openai / finetune-transformer-lm
Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
☆2,160Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for finetune-transformer-lm
- 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆1,511Updated 3 years ago
- ☆3,612Updated 2 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,892Updated last year
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,339Updated 7 months ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,182Updated last year
- Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://…☆2,389Updated 3 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,239Updated 8 months ago
- jiant is an nlp toolkit☆1,647Updated last year
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,197Updated 3 months ago
- Tensorflow implementation of contextualized word representations from bi-directional language models☆1,620Updated last year
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,118Updated last year
- A python tool for evaluating the quality of sentence embeddings.☆2,087Updated 8 months ago
- Phrase-Based & Neural Unsupervised Machine Translation☆1,506Updated 3 years ago
- Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granul…☆1,535Updated last year
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,247Updated last year
- Keras implementation of BERT with pre-trained weights☆813Updated 5 years ago
- InferSent sentence embeddings☆2,280Updated 3 years ago
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,412Updated 10 months ago
- 🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLP☆1,191Updated last year
- The Natural Language Decathlon: A Multitask Challenge for NLP☆2,344Updated 10 months ago
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,178Updated 2 months ago
- A curated list of pretrained sentence and word embedding models☆2,233Updated 3 years ago
- Models, data loaders and abstractions for language processing, powered by PyTorch☆3,517Updated this week
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,132Updated 9 months ago
- [DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations☆773Updated 3 years ago
- Longformer: The Long-Document Transformer☆2,047Updated last year
- Basic Utilities for PyTorch Natural Language Processing (NLP)☆2,213Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,187Updated last month
- Google AI 2018 BERT pytorch implementation☆6,223Updated last year
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,524Updated 4 years ago