Alternatives and similar repositories for following-instructions-human-feedback

Users that are interested in following-instructions-human-feedback are comparing it to the libraries listed below

• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,758Updated this week
• openai / summarize-from-feedback
  Code for "Learning to summarize from human feedback"
  ☆1,029Updated last year
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,338Updated last year
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆823Updated 2 years ago
• google-research / FLAN
  ☆1,525Updated this week
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆536Updated 9 months ago
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆1,000Updated 10 months ago
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,317Updated last year
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆813Updated 11 months ago
• openai / grade-school-math
  ☆1,283Updated last year
• allenai / natural-instructions
  Expanding natural instructions
  ☆1,002Updated last year
• IBM / Dromedary
  Dromedary: towards helpful, ethical and reliable LLMs.
  ☆1,148Updated last month
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆685Updated 3 months ago
• HazyResearch / ama_prompting
  Ask Me Anything language model prompting
  ☆546Updated last year
• bigscience-workshop / promptsource
  Toolkit for creating, sharing and using natural language prompts.
  ☆2,885Updated last year
• ruixiangcui / AGIEval
  ☆756Updated last year
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆2,014Updated 2 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆471Updated last year
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆866Updated last year
• yaodongC / awesome-instruction-dataset
  A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
  ☆1,120Updated last year
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,670Updated last year
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆464Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,395Updated last year
• salesforce / xgen
  Salesforce open-source LLMs with 8k sequence length.
  ☆717Updated 4 months ago
• hendrycks / test
  Measuring Massive Multitask Language Understanding | ICLR 2021
  ☆1,434Updated 2 years ago
• EleutherAI / the-pile
  ☆1,575Updated 2 years ago
• google-research / t5x
  ☆2,834Updated 2 weeks ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆808Updated last year
• young-geng / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆2,479Updated 10 months ago
• voidful / TextRL
  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…
  ☆559Updated last year