Alternatives and similar repositories for gpt-pytorch

Users that are interested in gpt-pytorch are comparing it to the libraries listed below

• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆235Updated 2 years ago
• facebookresearch / transformer-sequential
  Trains Transformer model variants. Data isn't shuffled between batches.
  ☆143Updated 3 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 5 years ago
• threelittlemonkeys / rnn-encoder-decoder-pytorch
  RNN Encoder-Decoder in PyTorch
  ☆45Updated last year
• sailab-code / gnn
  Graph Neural Network
  ☆44Updated 4 years ago
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆110Updated 7 years ago
• czyssrs / Few-Shot-NLG
  Code and Data for ACL 2020 paper "Few-Shot NLG with Pre-Trained Language Model"
  ☆190Updated 7 months ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆179Updated 2 years ago
• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆330Updated 2 years ago
• clarkkev / attention-analysis
  ☆471Updated 4 years ago
• facebookresearch / GraphLog
  API for accessing the GraphLog dataset
  ☆90Updated last year
• affjljoo3581 / GPT2
  PyTorch Implementation of OpenAI GPT-2
  ☆353Updated last year
• Andras7 / word2vec-pytorch
  Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling
  ☆189Updated 4 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆332Updated 3 years ago
• rish-16 / aft-pytorch
  Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.
  ☆244Updated 3 years ago
• mlpen / Nystromformer
  ☆388Updated 2 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆228Updated 4 years ago
• frederick0329 / TracIn
  Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)
  ☆237Updated 3 years ago
• kzl / universal-computation
  Official codebase for Pretrained Transformers as Universal Computation Engines.
  ☆247Updated 4 years ago
• lena-voita / the-story-of-heads
  This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…
  ☆318Updated 4 years ago
• louislva / deepmind-perceiver
  My implementation of DeepMind's Perceiver
  ☆63Updated 4 years ago
• willwhitney / reprieve
  A library for evaluating representations.
  ☆77Updated 4 years ago
• lucidrains / compressive-transformer-pytorch
  Pytorch implementation of Compressive Transformers, from Deepmind
  ☆163Updated 4 years ago
• alex-tifrea / poincare_glove
  Implementation of the "Poincare Glove: Hyperbolic word embeddings" paper
  ☆88Updated 5 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆111Updated 4 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆112Updated 2 years ago
• deep-spin / entmax
  The entmax mapping and its loss, a family of sparse softmax alternatives.
  ☆458Updated last year
• YilunZhou / ExSum
  Code repository for the NAACL 2022 paper "ExSum: From Local Explanations to Model Understanding"
  ☆64Updated 3 years ago
• neubig / minnn-assignment
  An assignment on creating a minimalist neural network toolkit for CS11-747
  ☆64Updated 2 years ago
• laiguokun / Funnel-Transformer
  ☆220Updated 5 years ago