Alternatives and similar repositories for reward-misspecification

Users that are interested in reward-misspecification are comparing it to the libraries listed below

• cassidylaidlaw / orpo
  ☆19Updated last year
• Open-Social-World / autolibra
  AutoLibra: Metric Induction for Agents from Open-Ended Human Feedback
  ☆16Updated last month
• ethz-spylab / superhuman-ai-consistency
  ☆30Updated 2 years ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last month
• facebookresearch / taskmet
  TaskMet Task-driven Metric Learning for Model Learning
  ☆20Updated last year
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆17Updated 8 months ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆20Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆18Updated 2 months ago
• yudasong / briee
  Representation Learning in RL
  ☆13Updated 3 years ago
• safety-research / SHADE-Arena
  ☆20Updated 5 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• mfederici / dsit
  Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"
  ☆25Updated 4 years ago
• googleinterns / localizing-paragraph-memorization
  ☆15Updated last year
• clarifying-EM / model-organisms-for-EM
  Code repo for the model organisms and convergent directions of EM papers.
  ☆40Updated 2 months ago
• lingo-mit / lm-truthfulness
  ☆17Updated last year
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)
  ☆72Updated last year
• Hritikbansal / jpo
  ☆13Updated 5 months ago
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆20Updated last year
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆57Updated 2 years ago
• THUNLP-MT / PGRA
  Prompt-Guided Retrieval For Non-Knowledge-Intensive Tasks
  ☆12Updated 2 years ago
• U-Sharma / NeuralScaleID
  ☆12Updated 5 years ago
• fra31 / rlhf-trojan-competition-submission
  ☆18Updated last year
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆20Updated 2 years ago
• ruizheng20 / gpo
  The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".
  ☆17Updated last year
• acmi-lab / pretraining-with-nonsense
  Pretraining summarization models using a corpus of nonsense
  ☆13Updated 4 years ago
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 3 years ago
• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆27Updated last year