Alternatives and similar repositories for pretraining-with-human-feedback:

Users that are interested in pretraining-with-human-feedback are comparing it to the libraries listed below

• tianjunz / HIR
  ☆159Updated 2 years ago
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆89Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆224Updated last year
• anthropics / ConstitutionalHarmlessnessPaper
  ☆236Updated 2 years ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆158Updated last year
• Dahoas / reward-modeling
  ☆97Updated last year
• architsharma97 / dpo-rlaif
  ☆96Updated 9 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated last year
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆205Updated last year
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• allenai / FineGrainedRLHF
  ☆274Updated 3 months ago
• orhonovich / unnatural-instructions
  ☆178Updated 2 years ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆74Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆85Updated last year
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 7 months ago
• debjitpaul / refiner
  About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…
  ☆70Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 2 years ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 11 months ago
• protagolabs / odyssey-math
  ☆83Updated 2 months ago
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆283Updated 2 months ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆114Updated 7 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆95Updated last year
• abdulhaim / LMRL-Gym
  ☆87Updated 9 months ago
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆163Updated last year
• lupantech / PromptPG
  Data and code for the ICLR 2023 paper "Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning".
  ☆150Updated last year
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆115Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆113Updated 4 months ago