Alternatives and similar repositories for openai-gpt-pytorch

Users that are interested in openai-gpt-pytorch are comparing it to the libraries listed below

• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• zbloss / reformer_lm
  a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)
  ☆53Updated 3 years ago
• nadavbh12 / Character-Level-Language-Modeling-with-Deeper-Self-Attention-pytorch
  Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch
  ☆62Updated 6 years ago
• benkrause / dynamiceval-transformer
  ☆47Updated 6 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 3 years ago
• tanyuqian / learning-data-manipulation
  NeurIPS 2019 - Learning Data Manipulation for Augmentation and Weighting
  ☆110Updated 5 years ago
• titu1994 / keras-LAMB-Optimizer
  Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
  ☆75Updated 6 years ago
• takase / control-length
  ☆53Updated 5 years ago
• shoarora / transformers-trainers
  Tools for training pytorch language models
  ☆27Updated 5 years ago
• golsun / SpaceFusion
  NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"
  ☆73Updated 5 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 6 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• harvardnlp / cascaded-generation
  Cascaded Text Generation with Markov Transformers
  ☆129Updated 2 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 4 years ago
• castorini / d-bert
  Distilling BERT using natural language generation.
  ☆39Updated 2 years ago
• ymcui / LAMB_Optimizer_TF
  LAMB Optimizer for Large Batch Training (TensorFlow version)
  ☆121Updated 5 years ago
• lyeoni / pretraining-for-language-understanding
  Pre-training of Language Models for Language Understanding
  ☆83Updated 6 years ago
• MC-BERT / MC-BERT
  ☆97Updated 5 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆228Updated 4 years ago
• tombosc / cpae
  Code for EMNLP 2018 paper "Auto-Encoding Dictionary Definitions into Consistent Word Embeddings"
  ☆36Updated 7 years ago
• CyberZHG / keras-adaptive-softmax
  Adaptive embedding and softmax
  ☆17Updated 3 years ago
• ajaech / query_completion
  Personalized Query Completion
  ☆27Updated 5 years ago
• rusiaaman / XLnet-gen
  XLNet for generating language.
  ☆166Updated 4 years ago
• lancopku / Prime
  A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
  ☆86Updated 2 years ago
• ctr4si / MMN
  Abstractive Summarization of Reddit Posts with Multi-level Memory Networks. In NAACL-HLT, 2019 (oral).
  ☆146Updated 5 years ago
• joel-huang / zeroshot-capsnet-pytorch
  GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks
  ☆16Updated 6 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 2 years ago