Alternatives and similar repositories for gpt-pytorch

Users that are interested in gpt-pytorch are comparing it to the libraries listed below

• affjljoo3581 / GPT2
  PyTorch Implementation of OpenAI GPT-2
  ☆336Updated 11 months ago
• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆329Updated last year
• czyssrs / Few-Shot-NLG
  Code and Data for ACL 2020 paper "Few-Shot NLG with Pre-Trained Language Model"
  ☆190Updated 2 weeks ago
• clarkkev / attention-analysis
  ☆462Updated 4 years ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆227Updated last year
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆107Updated 6 years ago
• facebookresearch / transformer-sequential
  Trains Transformer model variants. Data isn't shuffled between batches.
  ☆144Updated 2 years ago
• salesforce / GeDi
  GeDi: Generative Discriminator Guided Sequence Generation
  ☆210Updated 2 years ago
• yueyu1030 / COSINE
  [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…
  ☆203Updated 2 years ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆181Updated last year
• nlpyang / pytorch-transformers
  👾 A library of state-of-the-art pretrained models for Natural Language Processing (NLP)
  ☆23Updated 5 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆787Updated 2 years ago
• lena-voita / the-story-of-heads
  This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…
  ☆314Updated 3 years ago
• crux82 / ganbert
  Enhancing the BERT training with Semi-supervised Generative Adversarial Networks
  ☆229Updated 2 years ago
• Andras7 / word2vec-pytorch
  Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling
  ☆185Updated 4 years ago
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆106Updated 4 years ago
• JohnGiorgi / DeCLUTR
  The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to o…
  ☆380Updated 2 years ago
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆313Updated last year
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• shentianxiao / text-autoencoders
  ☆207Updated last year
• laiguokun / Funnel-Transformer
  ☆218Updated 4 years ago
• salesforce / simpletod
  Official repository for "SimpleTOD: A Simple Language Model for Task-Oriented Dialogue"
  ☆238Updated last month
• allenai / dont-stop-pretraining
  Code associated with the Don't Stop Pretraining ACL 2020 paper
  ☆531Updated 3 years ago
• yk / huggingface-nlp-demo
  ☆46Updated 5 years ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆93Updated last year
• chrisvdweth / ml-toolkit
  ☆64Updated 4 years ago
• roomylee / nlp-papers-with-arxiv
  Statistics and accepted paper list of NLP conferences with arXiv link
  ☆431Updated 3 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆329Updated 3 years ago
• voidism / DiffCSE
  Code for the NAACL 2022 long paper "DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings"
  ☆294Updated 2 years ago
• archinetai / smart-pytorch
  PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.
  ☆62Updated 2 years ago