Alternatives and similar repositories for minChatGPT:

Users that are interested in minChatGPT are comparing it to the libraries listed below

• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆186Updated 7 months ago
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆172Updated last year
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆184Updated last year
• Dahoas / reward-modeling
  ☆96Updated last year
• lucidrains / recurrent-memory-transformer-pytorch
  Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
  ☆407Updated 2 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆393Updated 10 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆222Updated last year
• sanjeevanahilan / nanoChatGPT
  A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick
  ☆289Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆244Updated 11 months ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆184Updated last year
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆628Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆177Updated last year
• sabetAI / BLoRA
  batched loras
  ☆340Updated last year
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆195Updated last year
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆226Updated 6 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆335Updated 6 months ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• TIGER-AI-Lab / MAmmoTH
  Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" (ICLR 2024)
  ☆364Updated 7 months ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆454Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆361Updated 10 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆129Updated last year
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆149Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆309Updated 2 years ago
• raunak-agarwal / instruction-datasets
  All available datasets for Instruction Tuning of Large Language Models
  ☆247Updated last year
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆801Updated 9 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆136Updated 4 months ago