affjljoo3581 / GPT2Links
PyTorch Implementation of OpenAI GPT-2
☆345Updated last year
Alternatives and similar repositories for GPT2
Users that are interested in GPT2 are comparing it to the libraries listed below
Sorting:
- The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-trained Transformer 2) for dialogue generation.☆176Updated last year
- Code for the ALiBi method for transformer language models (ICLR 2022)☆544Updated last year
- The universal integrated corpus-building environment.☆31Updated 5 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆473Updated last year
- Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation☆1,011Updated 6 years ago
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆935Updated 3 years ago
- Parallelformers: An Efficient Model Parallelization Toolkit for Deployment☆790Updated 2 years ago
- Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.☆473Updated last year
- Scalable PaLM implementation of PyTorch☆188Updated 2 years ago
- Fine tune a T5 transformer model using PyTorch & Transformers🤗☆219Updated 4 years ago
- Tutorial for how to build BERT from scratch☆99Updated last year
- Plain pytorch implementation of LLaMA☆188Updated 2 years ago
- Automatically split your PyTorch models on multiple GPUs for training & inference☆658Updated last year
- ☆69Updated 2 years ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆204Updated 2 years ago
- ☆350Updated 4 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆270Updated 2 years ago
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆172Updated 2 years ago
- A research project for natural language generation, containing the official implementations by MSRA NLC team.☆739Updated last year
- Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…☆565Updated last year
- Examples of training models with hybrid parallelism using ColossalAI☆339Updated 2 years ago
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆950Updated last year
- A minimum example of aligning language models with RLHF similar to ChatGPT☆222Updated 2 years ago
- Dialogue State Tracking (DST) Papers, Datasets, Resources 🤩☆193Updated 2 years ago
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆166Updated 4 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways☆824Updated 2 years ago
- Implementation of the first paper on word2vec☆245Updated 3 years ago
- Fine-tuning GPT-2 Small for Question Answering☆130Updated 2 years ago
- This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).☆112Updated 3 years ago
- Papers and Book to look at when starting AGI 📚☆289Updated last year