Alternatives and similar repositories for gpt-pytorch:

Users that are interested in gpt-pytorch are comparing it to the libraries listed below

• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆221Updated last year
• affjljoo3581 / GPT2
  PyTorch Implementation of OpenAI GPT-2
  ☆312Updated 7 months ago
• facebookresearch / transformer-sequential
  Trains Transformer model variants. Data isn't shuffled between batches.
  ☆139Updated 2 years ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆178Updated last year
• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆326Updated last year
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago
• google-research / bigbird
  Transformers for Longer Sequences
  ☆591Updated 2 years ago
• ethanjperez / true_few_shot
  Code for the paper "True Few-Shot Learning in Language Models" (https://arxiv.org/abs/2105.11447)
  ☆142Updated 3 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆226Updated 3 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• dhlee347 / pytorchic-bert
  Pytorch Implementation of Google BERT
  ☆593Updated 4 years ago
• czyssrs / Few-Shot-NLG
  Code and Data for ACL 2020 paper "Few-Shot NLG with Pre-Trained Language Model"
  ☆189Updated last year
• shentianxiao / text-autoencoders
  ☆207Updated 10 months ago
• clarkkev / attention-analysis
  ☆460Updated 3 years ago
• Andras7 / word2vec-pytorch
  Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling
  ☆183Updated 4 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆98Updated 6 years ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆72Updated 5 years ago
• allenai / unifiedqa
  UnifiedQA: Crossing Format Boundaries With a Single QA System
  ☆431Updated 2 years ago
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 4 years ago
• ChunyuanLI / Optimus
  Optimus: the first large-scale pre-trained VAE language model
  ☆380Updated last year
• FranxYao / Deep-Generative-Models-for-Natural-Language-Processing
  DGMs for NLP. A roadmap.
  ☆391Updated 2 years ago
• salesforce / GeDi
  GeDi: Generative Discriminator Guided Sequence Generation
  ☆208Updated 2 years ago
• JohnGiorgi / DeCLUTR
  The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to o…
  ☆381Updated last year
• Fraser-Greenlee / T5-VAE
  Checkout the new version at the link!
  ☆22Updated 4 years ago
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆515Updated last year
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆105Updated 3 years ago
• shmsw25 / AmbigQA
  An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"
  ☆117Updated 2 years ago
• n0obcoder / Skip-Gram-Model-PyTorch
  PyTorch implementation of the Word2Vec (Skip-Gram Model) and visualizing the trained embeddings using TSNE
  ☆53Updated 4 years ago
• naver / gdc
  Code accompanying our papers on the "Generative Distributional Control" framework
  ☆117Updated 2 years ago