cassidylaidlaw / hidden-contextLinks
Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"
☆33Updated 2 years ago
Alternatives and similar repositories for hidden-context
Users that are interested in hidden-context are comparing it to the libraries listed below
Sorting:
- Rewarded soups official implementation☆62Updated 2 years ago
- A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.☆46Updated last year
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated 2 years ago
- Implements the Messenger environment and EMMA model.☆25Updated 2 years ago
- Official implementation of "Direct Preference-based Policy Optimization without Reward Modeling" (NeurIPS 2023)☆42Updated last year
- Codebase for "Uni[MASK]: Unified Inference in Sequential Decision Problems"☆57Updated last year
- Representation Learning in RL☆13Updated 3 years ago
- Author's PyTorch implementation of SR-DICE for marginalized importance sampling☆28Updated 4 years ago
- Clean, extensible implementation of MACAW [ICML 2021]☆12Updated 4 years ago
- ☆110Updated last year
- ☆34Updated 2 years ago
- ☆10Updated 3 years ago
- Learning Safety Constraints for Large Language Models (ICML2025)☆28Updated 5 months ago
- Official code repo for paper: Hybrid RL: Using both offline and online data can make RL efficient.☆25Updated 2 years ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆47Updated 2 years ago
- Implementation of ICML 2023 paper: Future-conditioned Unsupervised Pretraining for Decision Transformer☆29Updated 2 years ago
- Code for "Task-Agnostic Continual RL: In Praise of a Simple Baseline"☆34Updated 2 years ago
- Learning to Modulate pre-trained Models in RL (Decision Transformer, LoRA, Fine-tuning)☆61Updated last year
- ☆22Updated 10 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆26Updated 3 months ago
- Tracking literature and additional online resources on transformers for sequential decision making including RL and beyond.☆49Updated 3 years ago
- Official code for "Can Wikipedia Help Offline Reinforcement Learning?" by Machel Reid, Yutaro Yamada and Shixiang Shane Gu☆106Updated 3 years ago
- Interpreting how transformers simulate agents performing RL tasks☆90Updated 2 years ago
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆32Updated last year
- Official data and code for our paper Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning☆52Updated 4 years ago
- ☆19Updated last year
- Reinforcement Learning via Regressing Relative Rewards☆38Updated last year
- Official PyTorch implementation of "Discovering Hierarchical Achievements in Reinforcement Learning via Contrastive Learning" (NeurIPS 20…☆35Updated 11 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆37Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆20Updated last year