Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
☆30Dec 19, 2023Updated 2 years ago
Alternatives and similar repositories for policy_optimization
Users that are interested in policy_optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)☆201Dec 16, 2023Updated 2 years ago
- Unofficial implementation of Chain of Hindsight (https://arxiv.org/abs/2302.02676) using pytorch and huggingface Trainers.☆11Apr 5, 2023Updated 3 years ago
- Code for ICLR 2022 Paper (HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning)☆12Nov 28, 2023Updated 2 years ago
- ☆19Oct 30, 2025Updated last year
- Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"☆42Sep 24, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- code for ROMANCE☆14Oct 12, 2024Updated 2 years ago
- A library for constrained RLHF.☆12Feb 19, 2024Updated 2 years ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)☆63May 12, 2025Updated last year
- This repo contains the code for the paper "Understanding and Mitigating Hallucinations in Large Vision-Language Models via Modular Attrib…☆41Jul 14, 2025Updated last year
- ☆14May 30, 2019Updated 7 years ago
- Codebase for Inference-Time Policy Adapters☆25Nov 3, 2023Updated 3 years ago
- Revisiting Peng's Q(lambda) for Modern Reinforcement Learning☆15Jul 23, 2021Updated 5 years ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆50Jan 19, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Self-Supervised Alignment with Mutual Information☆20May 24, 2024Updated 2 years ago
- ☆12Dec 22, 2021Updated 4 years ago
- [ICLR 2023 Oral] The official implementation of SQL and EQL in "Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Reg…☆46Jul 27, 2023Updated 3 years ago
- ☆49Oct 28, 2024Updated 2 years ago
- ☆11Mar 18, 2025Updated last year
- Code for Abstract-to-Executable Trajectory Translation for One Shot Task Generalization (ICML 2023)☆23May 12, 2023Updated 3 years ago
- re-implementation of the offline model-based RL algorithm MOPO in pytorch☆26Feb 28, 2022Updated 4 years ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆27Dec 12, 2023Updated 2 years ago
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆119Jun 23, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2025] "World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning." https://arxiv.org/abs/2503.1…☆18Jul 22, 2025Updated last year
- ☆10Jul 13, 2024Updated 2 years ago
- This repository contains the replication of the iGSM dataset generation process from the Physics of LLM paper by Zeyuan Zhu.☆17Sep 13, 2024Updated 2 years ago
- [ICML 2022] The official implementation of DWBC in "Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrations"☆37Jan 5, 2023Updated 3 years ago
- Levin tree search guided by both a policy and a heuristic function☆19Jul 13, 2023Updated 3 years ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆84Jan 14, 2025Updated last year
- ☆10Mar 10, 2024Updated 2 years ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Jan 17, 2024Updated 2 years ago
- [ICML2023] Revisiting Data-Free Knowledge Distillation with Poisoned Teachers☆25Jul 7, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆30Mar 1, 2022Updated 4 years ago
- RLA is a tool for managing your RL experiments automatically☆71Feb 7, 2023Updated 3 years ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆211Jul 19, 2024Updated 2 years ago
- ☆42May 2, 2024Updated 2 years ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆136Mar 22, 2024Updated 2 years ago
- Code for the paper Task Agnostic Morphology Evolution.☆21May 25, 2021Updated 5 years ago
- ☆14Oct 20, 2020Updated 6 years ago
Are these results useful?