Alternatives and similar repositories for GPT2:

Users that are interested in GPT2 are comparing it to the libraries listed below

• lyeoni / gpt-pytorch
  PyTorch Implementation of OpenAI GPT
  ☆122Updated last year
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆913Updated 10 months ago
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆209Updated 4 years ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆927Updated 2 years ago
• yxuansu / SimCTG
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆471Updated last year
• openai / summarize-from-feedback
  Code for "Learning to summarize from human feedback"
  ☆1,014Updated last year
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,296Updated last year
• affjljoo3581 / Expanda
  The universal integrated corpus-building environment.
  ☆30Updated 4 years ago
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆516Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,371Updated 11 months ago
• kipgparker / soft-prompt-tuning
  ☆344Updated 3 years ago
• XiangLi1999 / Diffusion-LM
  Diffusion-LM
  ☆1,107Updated 7 months ago
• Dahoas / reward-modeling
  ☆96Updated last year
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆171Updated last year
• voidful / TextRL
  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…
  ☆552Updated 10 months ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆193Updated 5 months ago
• Shark-NLP / DiffuSeq
  [ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
  ☆760Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆217Updated last year
• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆987Updated 5 years ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆192Updated 2 years ago
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆164Updated 3 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆786Updated last year
• jasonvanf / llama-trl
  LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
  ☆205Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆803Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆215Updated last year
• sangmichaelxie / doremi
  Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
  ☆313Updated last year
• uber-research / PPLM
  Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
  ☆1,141Updated last year
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,287Updated last year
• devjwsong / gpt2-dialogue-generation-pytorch
  The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-trained Transformer 2) for dialogue generation.
  ☆174Updated 9 months ago
• yaoxingcheng / TLM
  ICML'2022: NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework
  ☆259Updated last year