Alternatives and similar repositories for reward-misspecification

Users that are interested in reward-misspecification are comparing it to the libraries listed below

• cassidylaidlaw / orpo
  ☆19Updated 11 months ago
• Open-Social-World / autolibra
  AutoLibra: Metric Induction for Agents from Open-Ended Human Feedback
  ☆15Updated 2 weeks ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆31Updated 2 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• Hritikbansal / jpo
  ☆13Updated 3 months ago
• U-Sharma / NeuralScaleID
  ☆12Updated 5 years ago
• violet-zct / group-conditional-DRO
  Group-conditional DRO to alleviate spurious correlations
  ☆15Updated 4 years ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆21Updated last year
• facebookresearch / taskmet
  TaskMet Task-driven Metric Learning for Model Learning
  ☆19Updated last year
• uiuctml / fair-classification
  Post-processing for fair classification
  ☆16Updated 4 months ago
• zzwkk / MUA-RL
  MUA-RL: MULTI-TURN USER-INTERACTING AGENT REINFORCEMENT LEARNING FOR AGENTIC TOOL USE
  ☆38Updated last month
• yudasong / briee
  Representation Learning in RL
  ☆13Updated 3 years ago
• googleinterns / localizing-paragraph-memorization
  ☆15Updated last year
• hannamw / gpt2-greater-than
  Code Release for the 2023 NeurIPS Paper How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained langua…
  ☆15Updated 10 months ago
• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆17Updated 7 months ago
• lchen001 / HAPI
  ☆17Updated 2 years ago
• KempnerInstitute / llm_uncertainty
  Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"
  ☆10Updated last year
• allenbai01 / transformers-as-statisticians
  ☆34Updated 2 years ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆20Updated last year
• CausalML / MultipleLoggers
  Code for the paper "Optimal Off-Policy Evaluation from Multiple Logging Policies"
  ☆15Updated 4 years ago
• yaohungt / Pointwise_Dependency_Neural_Estimation
  ☆20Updated 5 years ago
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆57Updated 2 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago
• yifeiwang77 / Self-Correction
  ☆20Updated 11 months ago
• dmelis / robust_interpret
  Tools for robustness evaluation in interpretability methods
  ☆10Updated 4 years ago
• Junjie-Ye / MulDimIF
  A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models
  ☆17Updated 5 months ago