Alternatives and similar repositories for pretraining-with-human-feedback:

Users that are interested in pretraining-with-human-feedback are comparing it to the libraries listed below

• tianjunz / HIR
  ☆160Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆222Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆71Updated last year
• Dahoas / reward-modeling
  ☆96Updated last year
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆203Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆152Updated 11 months ago
• anthropics / ConstitutionalHarmlessnessPaper
  ☆228Updated 2 years ago
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆88Updated last year
• architsharma97 / dpo-rlaif
  ☆95Updated 7 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆86Updated 2 years ago
• abdulhaim / LMRL-Gym
  ☆78Updated 7 months ago
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆274Updated this week
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆97Updated 10 months ago
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆120Updated 3 months ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 9 months ago
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆176Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• orhonovich / unnatural-instructions
  ☆177Updated last year
• debjitpaul / refiner
  About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…
  ☆70Updated 11 months ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆64Updated 2 years ago
• FranxYao / GPT-Bargaining
  Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback
  ☆204Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆112Updated 8 months ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 5 months ago
• microsoft / RLHF-APA
  RL algorithm: Advantage induced policy alignment
  ☆62Updated last year
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆127Updated 10 months ago
• lupantech / PromptPG
  Data and code for the ICLR 2023 paper "Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning".
  ☆150Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆64Updated 7 months ago
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆157Updated last year