Alternatives and similar repositories for minChatGPT

Users that are interested in minChatGPT are comparing it to the libraries listed below

• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• sanjeevanahilan / nanoChatGPT
  A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick
  ☆290Updated last year
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆171Updated 2 years ago
• Dahoas / reward-modeling
  ☆96Updated 2 years ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆194Updated 11 months ago
• lucidrains / recurrent-memory-transformer-pytorch
  Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
  ☆410Updated 6 months ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆230Updated 10 months ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆645Updated 6 months ago
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆150Updated last year
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆185Updated 2 years ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆228Updated last year
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆187Updated last year
• zphang / minimal-llama
  ☆458Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆458Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆209Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆397Updated last year
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆339Updated 2 years ago
• jondurbin / bagel
  A bagel, with everything.
  ☆322Updated last year
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆166Updated last year
• SeanNaren / min-LLM
  Minimal code to train a Large Language Model (LLM).
  ☆170Updated 2 years ago
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆629Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆337Updated 2 weeks ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆200Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆477Updated 2 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• kyegomez / Sophia
  Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
  ☆380Updated last year
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆182Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆538Updated 9 months ago