Alternatives and similar repositories for GPT2

Users that are interested in GPT2 are comparing it to the libraries listed below

• devjwsong / gpt2-dialogue-generation-pytorch
  The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-trained Transformer 2) for dialogue generation.
  ☆176Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆536Updated last year
• voidful / TextRL
  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…
  ☆560Updated last year
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆216Updated 4 years ago
• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆1,001Updated 6 years ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆95Updated last year
• yxuansu / SimCTG
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆471Updated last year
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆791Updated 2 years ago
• microsoft / ProphetNet
  A research project for natural language generation, containing the official implementations by MSRA NLC team.
  ☆729Updated 11 months ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆934Updated last year
• affjljoo3581 / Expanda
  The universal integrated corpus-building environment.
  ☆31Updated 5 years ago
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆171Updated 2 years ago
• google-research / adapter-bert
  ☆494Updated last year
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆823Updated 2 years ago
• kipgparker / soft-prompt-tuning
  ☆346Updated 3 years ago
• gyunggyung / AGI-Papers
  Papers and Book to look at when starting AGI 📚
  ☆284Updated 9 months ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆934Updated 2 years ago
• OlgaChernytska / word2vec-pytorch
  Implementation of the first paper on word2vec
  ☆231Updated 3 years ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆190Updated 2 years ago
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆728Updated 2 years ago
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,344Updated last year
• facebookresearch / FiD
  Fusion-in-Decoder
  ☆573Updated last year
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆167Updated 3 years ago
• ftarlaci / GPT2sQA
  Fine-tuning GPT-2 Small for Question Answering
  ☆130Updated 2 years ago
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆339Updated 2 years ago
• dhlee347 / pytorchic-bert
  Pytorch Implementation of Google BERT
  ☆593Updated 5 years ago
• galatolofederico / vanilla-llama
  Plain pytorch implementation of LLaMA
  ☆188Updated 2 years ago
• hpcaitech / ColossalAI-Examples
  Examples of training models with hybrid parallelism using ColossalAI
  ☆340Updated 2 years ago
• francoisstamant / lyrics-generation-with-GPT2
  ☆68Updated 2 years ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆227Updated 2 years ago