Alternatives and similar repositories for GPT2:

Users that are interested in GPT2 are comparing it to the libraries listed below

• lyeoni / gpt-pytorch
  PyTorch Implementation of OpenAI GPT
  ☆121Updated last year
• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆985Updated 5 years ago
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆515Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,364Updated 11 months ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆178Updated last year
• affjljoo3581 / Expanda
  The universal integrated corpus-building environment.
  ☆29Updated 4 years ago
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆207Updated 4 years ago
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆164Updated 3 years ago
• ftarlaci / GPT2sQA
  Fine-tuning GPT-2 Small for Question Answering
  ☆129Updated 2 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆785Updated last year
• Xirider / finetune-gpt2xl
  Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpe…
  ☆437Updated last year
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆928Updated 2 years ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆910Updated 9 months ago
• yxuansu / SimCTG
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆469Updated 11 months ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆186Updated 5 months ago
• dhlee347 / pytorchic-bert
  Pytorch Implementation of Google BERT
  ☆593Updated 4 years ago
• openai / summarize-from-feedback
  Code for "Learning to summarize from human feedback"
  ☆1,006Updated last year
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆649Updated last year
• XiangLi1999 / Diffusion-LM
  Diffusion-LM
  ☆1,089Updated 6 months ago
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆443Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆100Updated 2 years ago
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆443Updated 10 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆87Updated 9 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆294Updated last year
• devjwsong / gpt2-dialogue-generation-pytorch
  The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-trained Transformer 2) for dialogue generation.
  ☆174Updated 8 months ago
• facebookresearch / atlas
  Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03…
  ☆526Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆217Updated last year
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆725Updated 2 years ago
• galatolofederico / vanilla-llama
  Plain pytorch implementation of LLaMA
  ☆189Updated last year
• Dahoas / reward-modeling
  ☆96Updated last year