Alternatives and similar repositories for lm-human-preferences

Users that are interested in lm-human-preferences are comparing it to the libraries listed below

• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,325Updated last year
• openai / summarize-from-feedback
  Code for "Learning to summarize from human feedback"
  ☆1,030Updated last year
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,760Updated 3 weeks ago
• google-research / FLAN
  ☆1,529Updated this week
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆2,018Updated 2 years ago
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆816Updated last year
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,630Updated 11 months ago
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,378Updated last year
• PKU-Alignment / safe-rlhf
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,501Updated last year
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,675Updated last year
• allenai / natural-instructions
  Expanding natural instructions
  ☆1,007Updated last year
• openai / following-instructions-human-feedback
  ☆1,229Updated 2 years ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆865Updated 2 weeks ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆809Updated last year
• voidful / TextRL
  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…
  ☆560Updated last year
• ruixiangcui / AGIEval
  ☆752Updated last year
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,618Updated last year
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆769Updated last year
• openai / grade-school-math
  ☆1,293Updated last year
• hendrycks / math
  The MATH Dataset (NeurIPS 2021)
  ☆1,148Updated 11 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,401Updated last year
• GaryYufei / AlignLLMHumanSurvey
  Aligning Large Language Models with Human: A Survey
  ☆730Updated last year
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆934Updated last year
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆686Updated 4 months ago
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,785Updated 6 months ago
• hendrycks / test
  Measuring Massive Multitask Language Understanding | ICLR 2021
  ☆1,447Updated 2 years ago
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆823Updated 2 years ago
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆904Updated 4 months ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,183Updated last year
• yaodongC / awesome-instruction-dataset
  A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
  ☆1,124Updated last year