Alternatives and similar repositories for GPT2:

Users that are interested in GPT2 are comparing it to the libraries listed below

• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆992Updated 5 years ago
• galatolofederico / vanilla-llama
  Plain pytorch implementation of LLaMA
  ☆187Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,386Updated last year
• affjljoo3581 / Expanda
  The universal integrated corpus-building environment.
  ☆29Updated 4 years ago
• kipgparker / soft-prompt-tuning
  ☆345Updated 3 years ago
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆212Updated 4 years ago
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,323Updated last year
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆786Updated 2 years ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆923Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆524Updated last year
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆864Updated last year
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,713Updated 2 months ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆931Updated 2 years ago
• lyeoni / gpt-pytorch
  PyTorch Implementation of OpenAI GPT
  ☆126Updated last year
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆167Updated 3 years ago
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,062Updated last month
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,305Updated last year
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆92Updated 11 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆219Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆561Updated 6 months ago
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆104Updated 3 years ago
• lucidrains / mixture-of-experts
  A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
  ☆736Updated last year
• uber-research / PPLM
  Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
  ☆1,144Updated last year
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆651Updated last year
• lena-voita / the-story-of-heads
  This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…
  ☆312Updated 3 years ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆197Updated last year
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆993Updated 9 months ago
• tunz / transformer-pytorch
  Transformer implementation in PyTorch.
  ☆486Updated 6 years ago
• tonyzhaozh / few-shot-learning
  Few-shot Learning of GPT-3
  ☆350Updated last year
• google-research / distilling-step-by-step
  ☆526Updated last year