jinpz / q_sharp
The official code release for Q#: Provably Optimal Distributional RL for LLM Post-Training
☆11Updated 2 months ago
Alternatives and similar repositories for q_sharp
Users that are interested in q_sharp are comparing it to the libraries listed below
Sorting:
- Rewarded soups official implementation☆57Updated last year
- Official implementation of "Direct Preference-based Policy Optimization without Reward Modeling" (NeurIPS 2023)☆42Updated 9 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆15Updated last month
- Official codebase for "The Generalization Gap in Offline Reinforcement Learning" accepted to ICLR 2024☆28Updated 9 months ago
- ☆92Updated 10 months ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆43Updated last year
- ☆32Updated 5 months ago
- Dateset Reset Policy Optimization☆30Updated last year
- Learning diverse options through the Laplacian representation.☆23Updated last year
- Implementation of the paper "Q-Adapter: Customizing Pre-trained LLMs to New Preferences with Forgetting Mitigation"☆16Updated 7 months ago
- Learning to Modulate pre-trained Models in RL (Decision Transformer, LoRA, Fine-tuning)☆56Updated 7 months ago
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated last year
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆29Updated 9 months ago
- Codebase for "Uni[MASK]: Unified Inference in Sequential Decision Problems"☆55Updated 10 months ago
- SocialJax: sequential social dilemma environments☆27Updated this week
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆28Updated last year
- Uni-RLHF platform for "Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback" (ICLR2024…☆36Updated 5 months ago
- A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.☆43Updated 4 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆155Updated 6 months ago
- Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models☆57Updated 2 months ago
- Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients☆26Updated 8 months ago
- ☆30Updated 6 months ago
- Official PyTorch implementation of "Discovering Hierarchical Achievements in Reinforcement Learning via Contrastive Learning" (NeurIPS 20…☆32Updated 2 months ago
- [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)☆20Updated 8 months ago
- Official Implementation of "Can Learned Optimization Make Reinforcement Learning Less Difficult"☆22Updated 3 weeks ago
- Learn online intrinsic rewards from LLM feedback☆37Updated 4 months ago
- Code release for "Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search" published at NeurIPS '24.☆10Updated 2 months ago
- This is an official implementation of the paper ``Building Math Agents with Multi-Turn Iterative Preference Learning'' with multi-turn DP…☆25Updated 5 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆94Updated last month
- Implementation (TensorFlow/keras) of the DreamerV3 model-based RL algorithm by Hafner et al. 2023☆3Updated last year