Alternatives and similar repositories for reward-misspecification

Users that are interested in reward-misspecification are comparing it to the libraries listed below

• Open-Social-World / autolibra
  AutoLibra: Metric Induction for Agents from Open-Ended Human Feedback
  ☆17Updated 2 months ago
• cassidylaidlaw / orpo
  ☆19Updated last year
• yudasong / briee
  Representation Learning in RL
  ☆13Updated 3 years ago
• yaohungt / Pointwise_Dependency_Neural_Estimation
  ☆21Updated 5 years ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated 2 months ago
• facebookresearch / taskmet
  TaskMet Task-driven Metric Learning for Model Learning
  ☆20Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆30Updated 2 years ago
• yiqiwang8177 / Official-codebase-for-Decision-Transducer
  This is the pytorch implementation of the UAI2023 paper "A Trajectory is Worth Three Sentences: Multimodal Transformer for Offline Reinf…
  ☆11Updated 2 years ago
• tianjunz / MADE
  ☆19Updated 4 years ago
• mfederici / dsit
  Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"
  ☆25Updated 4 years ago
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆20Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆20Updated last year
• Kaixhin / GUDRL
  Generalised UDRL
  ☆37Updated 3 years ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated 2 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• KempnerInstitute / llm_uncertainty
  Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"
  ☆10Updated last year
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆17Updated 9 months ago
• allenbai01 / transformers-as-statisticians
  ☆34Updated 2 years ago
• CausalML / MultipleLoggers
  Code for the paper "Optimal Off-Policy Evaluation from Multiple Logging Policies"
  ☆15Updated 4 years ago
• Hritikbansal / jpo
  ☆13Updated 6 months ago
• cassidylaidlaw / hidden-context
  Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"
  ☆32Updated 2 years ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated last year
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• joelouismarino / variational_rl
  Variational Reinforcement Learning
  ☆17Updated last year
• dmelis / robust_interpret
  Tools for robustness evaluation in interpretability methods
  ☆10Updated 4 years ago
• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• JonasGeiping / dataaugs
  ☆18Updated 3 years ago
• violet-zct / group-conditional-DRO
  Group-conditional DRO to alleviate spurious correlations
  ☆15Updated 4 years ago
• lchen001 / HAPI
  ☆17Updated 3 years ago