Alternatives and similar repositories for minChatGPT:

Users that are interested in minChatGPT are comparing it to the libraries listed below

• Dahoas / reward-modeling
  ☆96Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆86Updated 2 years ago
• lucidrains / recurrent-memory-transformer-pytorch
  Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
  ☆403Updated last week
• sanjeevanahilan / nanoChatGPT
  A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick
  ☆288Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆184Updated 5 months ago
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆166Updated last year
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆225Updated 4 months ago
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆185Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆388Updated 8 months ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆148Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆242Updated 9 months ago
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆171Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆510Updated last year
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆626Updated 11 months ago
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆439Updated 8 months ago
• tianjunz / HIR
  ☆161Updated last year
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆632Updated 3 weeks ago
• jondurbin / bagel
  A bagel, with everything.
  ☆315Updated 9 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆348Updated 8 months ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆222Updated last year
• lucidrains / simple-hierarchical-transformer
  Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
  ☆205Updated 4 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆157Updated last year
• sabetAI / BLoRA
  batched loras
  ☆336Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆306Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆122Updated 10 months ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆160Updated 8 months ago
• OpenBMB / UltraFeedback
  A large-scale, fine-grained, diverse preference dataset (and models).
  ☆325Updated last year
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆791Updated 6 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆172Updated 4 months ago