Alternatives and similar repositories for RLHF

Users that are interested in RLHF are comparing it to the libraries listed below

• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆394Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆134Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 11 months ago
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated 2 years ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆297Updated 3 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆262Updated 9 months ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆481Updated 2 years ago
• xfactlab / orpo
  Official repository for ORPO
  ☆464Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆142Updated last week
• huggingface / llm_training_handbook
  An open collection of methodologies to help with successful training of large language models.
  ☆512Updated last year
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆379Updated 2 years ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆288Updated 7 months ago
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆99Updated 3 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆126Updated 2 years ago
• rasbt / LLM-finetuning-scripts
  ☆216Updated last year
• SALT-NLP / demonstrated-feedback
  ☆128Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆249Updated 11 months ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆203Updated 2 years ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆87Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 3 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆137Updated 4 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• neubig / minllama-assignment
  ☆96Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆274Updated last year
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆136Updated 9 months ago
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆173Updated 2 years ago