Alternatives and similar repositories for GPT2

Users that are interested in GPT2 are comparing it to the libraries listed below

• affjljoo3581 / Expanda
  The universal integrated corpus-building environment.
  ☆30Updated 4 years ago
• lyeoni / gpt-pytorch
  PyTorch Implementation of OpenAI GPT
  ☆127Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆530Updated last year
• galatolofederico / vanilla-llama
  Plain pytorch implementation of LLaMA
  ☆187Updated 2 years ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆93Updated last year
• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆997Updated 5 years ago
• jasonvanf / llama-trl
  LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
  ☆217Updated 2 years ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆933Updated 2 years ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆865Updated last year
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆173Updated 2 years ago
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆213Updated 4 years ago
• Hzfinfdu / Diffusion-BERT
  ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
  ☆308Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆220Updated last year
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆930Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆218Updated last year
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆189Updated 2 years ago
• francoisstamant / lyrics-generation-with-GPT2
  ☆69Updated 2 years ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆757Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆809Updated last year
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆681Updated 2 months ago
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆730Updated 2 years ago
• XiangLi1999 / Diffusion-LM
  Diffusion-LM
  ☆1,147Updated 9 months ago
• thu-coai / PaperForONLG
  Paper list for open-ended language generation
  ☆193Updated 2 years ago
• mingkaid / rl-prompt
  Accompanying repo for the RLPrompt paper
  ☆329Updated 11 months ago
• tonyzhaozh / few-shot-learning
  Few-shot Learning of GPT-3
  ☆351Updated last year
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆821Updated 2 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆472Updated last year
• tunz / transformer-pytorch
  Transformer implementation in PyTorch.
  ☆487Updated 6 years ago
• Dahoas / reward-modeling
  ☆96Updated 2 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆787Updated 2 years ago