Alternatives and similar repositories for RLHF

Users that are interested in RLHF are comparing it to the libraries listed below

• naver / bergen
  Benchmarking library for RAG
  ☆206Updated this week
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 5 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆453Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆322Updated 6 months ago
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆364Updated last year
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆203Updated 5 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 7 months ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆200Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆118Updated 3 weeks ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆851Updated last week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 6 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 7 months ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆182Updated last year
• SALT-NLP / demonstrated-feedback
  ☆120Updated 8 months ago
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆254Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆279Updated 3 months ago
• huggingface / llm_training_handbook
  An open collection of methodologies to help with successful training of large language models.
  ☆492Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆258Updated 10 months ago
• huggingface / cosmopedia
  ☆517Updated 6 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆122Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆344Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆473Updated 2 years ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆590Updated this week
• allenai / FineGrainedRLHF
  ☆276Updated 4 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆221Updated 6 months ago
• karthikv792 / LLMs-Planning
  An extensible benchmark for evaluating large language models on planning
  ☆375Updated last month