Alternatives and similar repositories for reward-misspecification

Users that are interested in reward-misspecification are comparing it to the libraries listed below

• cassidylaidlaw / orpo
  ☆18Updated 10 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated 2 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• KempnerInstitute / llm_uncertainty
  Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"
  ☆10Updated last year
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆16Updated 3 years ago
• tsukushiAI / self-organized-agent
  A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization
  ☆15Updated 9 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆21Updated last year
• yaohungt / Pointwise_Dependency_Neural_Estimation
  ☆20Updated 5 years ago
• violet-zct / group-conditional-DRO
  Group-conditional DRO to alleviate spurious correlations
  ☆15Updated 4 years ago
• counterfactual-ml / kdd2022-tutorial
  Counterfactual Evaluation and Learning for Interactive Systems: Foundations, Implementations, and Recent Advances
  ☆12Updated 3 years ago
• yudasong / briee
  Representation Learning in RL
  ☆13Updated 3 years ago
• visinf / fast-axiomatic-attribution
  Fast Axiomatic Attribution for Neural Networks (NeurIPS*2021)
  ☆16Updated 2 years ago
• Hritikbansal / jpo
  ☆13Updated 2 months ago
• lchen001 / HAPI
  ☆17Updated 2 years ago
• CausalML / MultipleLoggers
  Code for the paper "Optimal Off-Policy Evaluation from Multiple Logging Policies"
  ☆15Updated 4 years ago
• facebookresearch / taskmet
  TaskMet Task-driven Metric Learning for Model Learning
  ☆19Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 9 months ago
• tianjunz / MADE
  ☆19Updated 4 years ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• allenbai01 / transformers-as-statisticians
  ☆33Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• ruizheng20 / gpo
  The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".
  ☆17Updated last year
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago
• safety-research / SHADE-Arena
  ☆19Updated 3 months ago
• mfederici / dsit
  Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"
  ☆25Updated 3 years ago
• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• uiuctml / fair-classification
  Post-processing for fair classification
  ☆16Updated 2 months ago