Alternatives and similar repositories for gpt-pytorch:

Users that are interested in gpt-pytorch are comparing it to the libraries listed below

• affjljoo3581 / GPT2
  PyTorch Implementation of OpenAI GPT-2
  ☆326Updated 8 months ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆178Updated last year
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆103Updated 6 years ago
• czyssrs / Few-Shot-NLG
  Code and Data for ACL 2020 paper "Few-Shot NLG with Pre-Trained Language Model"
  ☆189Updated 2 years ago
• facebookresearch / transformer-sequential
  Trains Transformer model variants. Data isn't shuffled between batches.
  ☆141Updated 2 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆226Updated 3 years ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆224Updated last year
• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆327Updated last year
• rish-16 / aft-pytorch
  Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.
  ☆234Updated 2 years ago
• teddykoker / image-gpt
  PyTorch Implementation of OpenAI's Image GPT
  ☆254Updated last year
• andrewpeng02 / transformer-translation
  Using Pytorch's nn.Transformer module to create an english to french neural machine translation model.
  ☆77Updated 4 years ago
• clarkkev / attention-analysis
  ☆462Updated 3 years ago
• Andras7 / word2vec-pytorch
  Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling
  ☆185Updated 4 years ago
• p-null / openai-gpt-pytorch
  Pytorch implementation of OpenAI-GPT for ROC stories
  ☆51Updated 6 years ago
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆312Updated last year
• cimeister / typical-sampling
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆82Updated 3 years ago
• SKRohit / Generating_Text_Summary_With_GPT2
  A simple approach to use GPT2-medium (345M) for generating high quality text summaries with minimal training.
  ☆156Updated 2 years ago
• urvashik / knnlm
  ☆318Updated 3 years ago
• salesforce / GeDi
  GeDi: Generative Discriminator Guided Sequence Generation
  ☆208Updated 2 years ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆72Updated 5 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆146Updated 3 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆70Updated last year
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆187Updated 2 years ago
• dhlee347 / pytorchic-bert
  Pytorch Implementation of Google BERT
  ☆594Updated 5 years ago
• mf1024 / Transformers
  Ipython notebooks of walk-trough Transformer model implementations in PyTorch and GPT-2 fine-tuning.
  ☆23Updated 5 years ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆159Updated 10 months ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆295Updated 2 years ago
• laiguokun / Funnel-Transformer
  ☆216Updated 4 years ago
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆520Updated last year
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago