Alternatives and similar repositories for gpt-pytorch

Users that are interested in gpt-pytorch are comparing it to the libraries listed below

• facebookresearch / transformer-sequential
  Trains Transformer model variants. Data isn't shuffled between batches.
  ☆143Updated 3 years ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆235Updated 2 years ago
• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆330Updated last year
• clarkkev / attention-analysis
  ☆470Updated 4 years ago
• rish-16 / aft-pytorch
  Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.
  ☆242Updated 3 years ago
• vinsis / math-and-ml-notes
  Books, papers and links to latest research in ML/AI
  ☆91Updated last year
• threelittlemonkeys / rnn-encoder-decoder-pytorch
  RNN Encoder-Decoder in PyTorch
  ☆45Updated last year
• sailab-code / gnn
  Graph Neural Network
  ☆44Updated 4 years ago
• czyssrs / Few-Shot-NLG
  Code and Data for ACL 2020 paper "Few-Shot NLG with Pre-Trained Language Model"
  ☆190Updated 5 months ago
• mlpen / Nystromformer
  ☆383Updated 2 years ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆179Updated 2 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆330Updated 3 years ago
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆109Updated 7 years ago
• affjljoo3581 / GPT2
  PyTorch Implementation of OpenAI GPT-2
  ☆345Updated last year
• facebookresearch / GraphLog
  API for accessing the GraphLog dataset
  ☆90Updated last year
• Andras7 / word2vec-pytorch
  Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling
  ☆188Updated 4 years ago
• shreyansh26 / Annotated-ML-Papers
  Annotations of the interesting ML papers I read
  ☆262Updated 2 weeks ago
• shentianxiao / text-autoencoders
  ☆212Updated last year
• OlgaChernytska / word2vec-pytorch
  Implementation of the first paper on word2vec
  ☆245Updated 3 years ago
• willwhitney / reprieve
  A library for evaluating representations.
  ☆77Updated 3 years ago
• bentrevett / a-tour-of-pytorch-optimizers
  A tour of different optimization algorithms in PyTorch.
  ☆99Updated 3 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 2 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆296Updated 3 years ago
• BramVanroy / bert-for-inference
  A small repo showing how to easily use BERT (or other transformers) for inference
  ☆99Updated 5 years ago
• chirag-agarwall / VOG
  Estimating Example Difficulty using Variance of Gradients
  ☆64Updated 2 years ago
• lena-voita / the-story-of-heads
  This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…
  ☆315Updated 4 years ago
• FranxYao / Deep-Generative-Models-for-Natural-Language-Processing
  DGMs for NLP. A roadmap.
  ☆393Updated 2 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆151Updated 2 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆227Updated 4 years ago
• Rick-McCoy / Reformer-pytorch
  Implements Reformer: The Efficient Transformer in pytorch.
  ☆86Updated 5 years ago