affjljoo3581 / GPT2

Related projects ⓘ

Alternatives and complementary repositories for GPT2

• graykode / gpt-2-Pytorch
  Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
  ☆972Updated 5 years ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆923Updated 2 years ago
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆506Updated last year
• XiangLi1999 / Diffusion-LM
  Diffusion-LM
  ☆1,055Updated 3 months ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆895Updated 6 months ago
• Shark-NLP / DiffuSeq
  [ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
  ☆731Updated 8 months ago
• lyeoni / gpt-pytorch
  PyTorch Implementation of OpenAI GPT
  ☆118Updated last year
• tunz / transformer-pytorch
  Transformer implementation in PyTorch.
  ☆464Updated 5 years ago
• dhlee347 / pytorchic-bert
  Pytorch Implementation of Google BERT
  ☆590Updated 4 years ago
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆812Updated 2 years ago
• microsoft / ProphetNet
  A research project for natural language generation, containing the official implementations by MSRA NLC team.
  ☆690Updated 3 months ago
• yxuansu / SimCTG
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆466Updated 8 months ago
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆196Updated 3 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,335Updated 7 months ago
• ChunyuanLI / Optimus
  Optimus: the first large-scale pre-trained VAE language model
  ☆369Updated last year
• google-research / adapter-bert
  ☆484Updated last year
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆103Updated 3 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆466Updated 8 months ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆222Updated last year
• kipgparker / soft-prompt-tuning
  ☆339Updated 3 years ago
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆177Updated last year
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆624Updated 10 months ago
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,045Updated last year
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,227Updated last year
• facebookresearch / DPR
  Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
  ☆1,723Updated last year
• Xirider / finetune-gpt2xl
  Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpe…
  ☆432Updated last year
• allenai / natural-instructions
  Expanding natural instructions
  ☆956Updated 11 months ago
• lucidrains / mixture-of-experts
  A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
  ☆639Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆207Updated 11 months ago
• tonyzhaozh / few-shot-learning
  Few-shot Learning of GPT-3
  ☆342Updated last year