Alternatives and similar repositories for openai-gpt-pytorch

Users that are interested in openai-gpt-pytorch are comparing it to the libraries listed below

• benkrause / dynamiceval-transformer
  ☆47Updated 6 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• zbloss / reformer_lm
  a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)
  ☆53Updated 3 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 3 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago
• laiguokun / Funnel-Transformer
  ☆220Updated 5 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆228Updated 4 years ago
• cambridgeltl / parameter-factorization
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Updated 5 years ago
• nadavbh12 / Character-Level-Language-Modeling-with-Deeper-Self-Attention-pytorch
  Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch
  ☆62Updated 6 years ago
• lancopku / Prime
  A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
  ☆86Updated 2 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆137Updated 6 years ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆310Updated 4 years ago
• harvardnlp / cascaded-generation
  Cascaded Text Generation with Markov Transformers
  ☆129Updated 2 years ago
• golsun / SpaceFusion
  NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"
  ☆73Updated 5 years ago
• shoarora / transformers-trainers
  Tools for training pytorch language models
  ☆27Updated 5 years ago
• ymcui / LAMB_Optimizer_TF
  LAMB Optimizer for Large Batch Training (TensorFlow version)
  ☆121Updated 5 years ago
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆174Updated 5 years ago
• takase / control-length
  ☆53Updated 5 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 5 years ago
• tanyuqian / learning-data-manipulation
  NeurIPS 2019 - Learning Data Manipulation for Augmentation and Weighting
  ☆110Updated 5 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 2 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 6 years ago
• namisan / exdeep-nmt
  ☆32Updated 4 years ago
• dojoteef / synst
  Source code to reproduce the results in the ACL 2019 paper "Syntactically Supervised Transformers for Faster Neural Machine Translation"
  ☆81Updated 3 years ago
• harvardnlp / encoder-agnostic-adaptation
  Encoder-Agnostic Adaptation for Conditional Language Generation
  ☆80Updated last year
• TimDettmers / transformer-xl
  ☆65Updated 5 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆153Updated 2 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆134Updated last year