Alternatives and similar repositories for pretraining-with-human-feedback

Users that are interested in pretraining-with-human-feedback are comparing it to the libraries listed below

• tianjunz / HIR
  ☆159Updated 2 years ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆228Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆90Updated last year
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆208Updated last year
• microsoft / RLHF-APA
  RL algorithm: Advantage induced policy alignment
  ☆65Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆162Updated 2 months ago
• anthropics / ConstitutionalHarmlessnessPaper
  ☆238Updated 2 years ago
• Dahoas / reward-modeling
  ☆96Updated 2 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• FranxYao / GPT-Bargaining
  Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback
  ☆207Updated 2 years ago
• architsharma97 / dpo-rlaif
  ☆98Updated last year
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆81Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆337Updated 2 weeks ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆161Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• orhonovich / unnatural-instructions
  ☆180Updated 2 years ago
• protagolabs / odyssey-math
  ☆83Updated 5 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 2 weeks ago
• debjitpaul / refiner
  About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…
  ☆70Updated last year
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆161Updated last year
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆70Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 10 months ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆124Updated 9 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆136Updated last year
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆289Updated 4 months ago