mansicer / Q-Adapter
Implementation of the paper "Q-Adapter: Customizing Pre-trained LLMs to New Preferences with Forgetting Mitigation"
☆16Updated 7 months ago
Alternatives and similar repositories for Q-Adapter
Users that are interested in Q-Adapter are comparing it to the libraries listed below
Sorting:
- Learning to Modulate pre-trained Models in RL (Decision Transformer, LoRA, Fine-tuning)☆56Updated 7 months ago
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated last year
- Accelerating Research in Plasticity-Motivated Deep Reinforcement Learning.☆22Updated 3 weeks ago
- Uni-RLHF platform for "Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback" (ICLR2024…☆36Updated 5 months ago
- Official implementation of "Direct Preference-based Policy Optimization without Reward Modeling" (NeurIPS 2023)☆42Updated 9 months ago
- ☆11Updated last year
- Offline RLHF codebase implementation for "Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human …☆37Updated last year
- PyTorch implementations for Offline Preference-Based RL (PbRL) algorithms☆20Updated last month
- Exploring techniques to generate diverse conventions in multi-agent settings☆14Updated last year
- Dateset Reset Policy Optimization☆30Updated last year
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆43Updated last year
- Implementation of ICML 2023 paper: Future-conditioned Unsupervised Pretraining for Decision Transformer☆27Updated last year
- Minimal RLHF implementation built on top of minGPT.☆28Updated 10 months ago
- Guide Your Agent with Adaptive Multimodal Rewards (NeurIPS 2023 Accepted)☆33Updated last year
- ☆29Updated last year
- Official codebase for "The Generalization Gap in Offline Reinforcement Learning" accepted to ICLR 2024☆28Updated 9 months ago
- ☆23Updated last year
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆29Updated 9 months ago
- Rewarded soups official implementation☆57Updated last year
- Official code for "Unleashing the Power of Pre-trained Language Models for Offline Reinforcement Learning".☆47Updated last year
- Official code for ACT: Empowering Decision Transformer with Dynamic Programming via Advantage Conditioning (AAAI'24)☆13Updated last year
- ☆10Updated 2 years ago
- code for the paper Offline Prioritized Experience Replay☆13Updated last year
- The official code release for Q#: Provably Optimal Distributional RL for LLM Post-Training☆11Updated 2 months ago
- Codebase for "Uni[MASK]: Unified Inference in Sequential Decision Problems"☆55Updated 10 months ago
- Implements the Messenger environment and EMMA model.☆23Updated last year
- SCoRe: Training Language Models to Self-Correct via Reinforcement Learning☆9Updated 3 months ago
- Official Codebase for TMLR 2023, Benchmarks and Algorithms for Offline Preference-Based Reward Learning☆20Updated 2 years ago
- Related papers for offline reforcement learning (we mainly focus on representation and sequence modeling and conventional offline RL)☆18Updated 3 years ago
- ☆24Updated 7 months ago