Alternatives and similar repositories for pretraining-with-human-feedback

Users that are interested in pretraining-with-human-feedback are comparing it to the libraries listed below

• tianjunz / HIR
  ☆159Updated 2 years ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆226Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆89Updated last year
• anthropics / ConstitutionalHarmlessnessPaper
  ☆236Updated 2 years ago
• Dahoas / reward-modeling
  ☆96Updated 2 years ago
• architsharma97 / dpo-rlaif
  ☆97Updated 11 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆76Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆86Updated 2 years ago
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆207Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆161Updated 3 weeks ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆159Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• abdulhaim / LMRL-Gym
  ☆93Updated 11 months ago
• debjitpaul / refiner
  About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…
  ☆70Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆124Updated 11 months ago
• orhonovich / unnatural-instructions
  ☆178Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 8 months ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆70Updated 2 years ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆106Updated last year
• da03 / implicit_chain_of_thought
  ☆131Updated 6 months ago
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆159Updated last week
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆70Updated 2 years ago
• microsoft / RLHF-APA
  RL algorithm: Advantage induced policy alignment
  ☆65Updated last year
• protagolabs / odyssey-math
  ☆82Updated 4 months ago
• FranxYao / GPT-Bargaining
  Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback
  ☆206Updated 2 years ago
• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆69Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 8 months ago