McGill-NLP / VinePPO
Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
☆151Updated 5 months ago
Alternatives and similar repositories for VinePPO:
Users that are interested in VinePPO are comparing it to the libraries listed below
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆120Updated 7 months ago
- ☆90Updated 9 months ago
- ☆175Updated last year
- Repo of paper "Free Process Rewards without Process Labels"☆143Updated last month
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆162Updated last week
- ☆137Updated 5 months ago
- GenRM-CoT: Data release for verification rationales☆56Updated 6 months ago
- This is an official implementation of the paper ``Building Math Agents with Multi-Turn Iterative Preference Learning'' with multi-turn DP…☆25Updated 4 months ago
- ☆96Updated 9 months ago
- ☆107Updated 3 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆264Updated 10 months ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆55Updated 10 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆103Updated last year
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆54Updated 6 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆91Updated 3 weeks ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆45Updated 3 weeks ago
- Replicating O1 inference-time scaling laws☆83Updated 4 months ago
- ☆65Updated last year
- ☆157Updated 3 weeks ago
- ☆30Updated 5 months ago
- RLHF implementation details of OAI's 2019 codebase☆186Updated last year
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆132Updated 7 months ago
- Natural Language Reinforcement Learning☆87Updated 4 months ago
- ☆63Updated 5 months ago
- A brief and partial summary of RLHF algorithms.☆127Updated last month
- Rewarded soups official implementation☆58Updated last year
- Language models scale reliably with over-training and on downstream tasks☆96Updated last year
- ☆89Updated 6 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆53Updated 8 months ago
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆136Updated 2 months ago