Alternatives and similar repositories for GPT2:

Users that are interested in GPT2 are comparing it to the libraries listed below

• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆989Updated 5 years ago
• affjljoo3581 / Expanda
  The universal integrated corpus-building environment.
  ☆30Updated 4 years ago
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,305Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,378Updated last year
• lyeoni / gpt-pytorch
  PyTorch Implementation of OpenAI GPT
  ☆124Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆519Updated last year
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆917Updated 11 months ago
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆164Updated 3 years ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆929Updated 2 years ago
• kipgparker / soft-prompt-tuning
  ☆345Updated 3 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆785Updated last year
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆224Updated last year
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,294Updated last year
• devjwsong / gpt2-dialogue-generation-pytorch
  The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-trained Transformer 2) for dialogue generation.
  ☆175Updated 10 months ago
• voidful / TextRL
  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…
  ☆555Updated 10 months ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆471Updated 2 years ago
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆727Updated 2 years ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆260Updated 7 months ago
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆103Updated 2 years ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆859Updated last year
• yxuansu / SimCTG
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆471Updated last year
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆819Updated 2 years ago
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆172Updated last year
• nyu-mll / GLUE-baselines
  [DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations
  ☆791Updated 3 years ago
• jasonvanf / llama-trl
  LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
  ☆206Updated last year
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆209Updated 4 years ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆90Updated 10 months ago
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆321Updated 9 months ago
• XiangLi1999 / Diffusion-LM
  Diffusion-LM
  ☆1,115Updated 7 months ago
• Shark-NLP / DiffuSeq
  [ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
  ☆763Updated last year