microsoft / RLHF-APA
RL algorithm: Advantage induced policy alignment
☆62Updated last year
Alternatives and similar repositories for RLHF-APA:
Users that are interested in RLHF-APA are comparing it to the libraries listed below
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆51Updated 8 months ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆40Updated last year
- A repository for transformer critique learning and generation☆88Updated last year
- ☆95Updated 7 months ago
- ☆132Updated 2 months ago
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆66Updated last year
- This is an official implementation of the paper ``Building Math Agents with Multi-Turn Iterative Preference Learning'' with multi-turn DP…☆20Updated 2 months ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆30Updated 2 months ago
- ☆55Updated 3 months ago
- GenRM-CoT: Data release for verification rationales☆46Updated 3 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆120Updated 3 months ago
- ☆96Updated last year
- ☆78Updated 7 months ago
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆115Updated 5 months ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆50Updated 8 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆65Updated 5 months ago
- ☆27Updated 11 months ago
- ☆160Updated last year
- ☆44Updated last year
- Directional Preference Alignment☆54Updated 4 months ago
- ☆22Updated last year
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆64Updated 2 years ago
- Rewarded soups official implementation☆55Updated last year
- [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards☆48Updated 9 months ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆53Updated 5 months ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆127Updated 10 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆72Updated 8 months ago
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆15Updated last month
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- Domain-specific preference (DSP) data and customized RM fine-tuning.☆24Updated 11 months ago