Alternatives and similar repositories for openai-gpt-pytorch

Users that are interested in openai-gpt-pytorch are comparing it to the libraries listed below

• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• zbloss / reformer_lm
  a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)
  ☆53Updated 2 years ago
• benkrause / dynamiceval-transformer
  ☆47Updated 6 years ago
• shoarora / transformers-trainers
  Tools for training pytorch language models
  ☆27Updated 4 years ago
• lancopku / Prime
  A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
  ☆86Updated 2 years ago
• gonglinyuan / StackingBERT
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆113Updated 6 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago
• takase / control-length
  ☆53Updated 5 years ago
• golsun / SpaceFusion
  NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"
  ☆73Updated 5 years ago
• leimao / Two-Layer-Hierarchical-Softmax-PyTorch
  Two-Layer Hierarchical Softmax Implementation for PyTorch
  ☆70Updated 4 years ago
• harvardnlp / cascaded-generation
  Cascaded Text Generation with Markov Transformers
  ☆129Updated 2 years ago
• nadavbh12 / Character-Level-Language-Modeling-with-Deeper-Self-Attention-pytorch
  Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch
  ☆62Updated 6 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 6 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆227Updated 4 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆158Updated 5 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 6 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 2 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 4 years ago
• ctr4si / MMN
  Abstractive Summarization of Reddit Posts with Multi-level Memory Networks. In NAACL-HLT, 2019 (oral).
  ☆146Updated 5 years ago
• namisan / exdeep-nmt
  ☆32Updated 4 years ago
• cambridgeltl / parameter-factorization
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Updated 5 years ago
• tanyuqian / learning-data-manipulation
  NeurIPS 2019 - Learning Data Manipulation for Augmentation and Weighting
  ☆110Updated 5 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 2 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆133Updated last year
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆310Updated 4 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆151Updated 2 years ago
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆173Updated 5 years ago
• wellecks / nonmonotonic_text
  Non-Monotonic Sequential Text Generation (ICML 2019)
  ☆72Updated 6 years ago