tedmoskovitz / ConstrainedRL4LMs
A library for constrained RLHF.
☆13Updated 11 months ago
Alternatives and similar repositories for ConstrainedRL4LMs:
Users that are interested in ConstrainedRL4LMs are comparing it to the libraries listed below
- Direct preference optimization with f-divergences.☆13Updated 2 months ago
- Rewarded soups official implementation☆55Updated last year
- ☆76Updated 6 months ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆125Updated 10 months ago
- ☆69Updated last year
- A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.☆35Updated 2 weeks ago
- Official code repository for Prompt-DT.☆102Updated 2 years ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆40Updated last year
- [NeurIPS 2023] Large Language Models Are Semi-Parametric Reinforcement Learning Agents☆33Updated 8 months ago
- Implementation of TWOSOME☆62Updated 2 weeks ago
- ☆27Updated 2 months ago
- Learning to Modulate pre-trained Models in RL (Decision Transformer, LoRA, Fine-tuning)☆52Updated 3 months ago
- ☆127Updated 2 months ago
- Official implementation of "Direct Preference-based Policy Optimization without Reward Modeling" (NeurIPS 2023)☆41Updated 6 months ago
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆127Updated 9 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆114Updated 2 months ago
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆22Updated 5 months ago
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆112Updated 4 months ago
- GenRM-CoT: Data release for verification rationales☆45Updated 3 months ago
- ☆28Updated last month
- a simple and scalable agent for training adaptive policies with sequence-based RL☆108Updated last week
- Codebase for "Uni[MASK]: Unified Inference in Sequential Decision Problems"☆53Updated 6 months ago
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆24Updated last year
- RLHF implementation details of OAI's 2019 codebase☆171Updated last year
- Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"☆55Updated last month
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆64Updated 5 months ago
- Implemention of the Decision-Pretrained Transformer (DPT) from the paper Supervised Pretraining Can Learn In-Context Reinforcement Learni…☆57Updated 8 months ago
- Official code for "Unleashing the Power of Pre-trained Language Models for Offline Reinforcement Learning".☆39Updated 9 months ago
- ☆26Updated last year
- Reasoning with Language Model is Planning with World Model☆156Updated last year