raghavc / LLM-RLHF-Tuning-with-PPO-and-DPOLinks
Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Alpaca, LLaMA, and LLaMA2 models.
☆165Updated last year
Alternatives and similar repositories for LLM-RLHF-Tuning-with-PPO-and-DPO
Users that are interested in LLM-RLHF-Tuning-with-PPO-and-DPO are comparing it to the libraries listed below
Sorting:
- minimal GRPO implementation from scratch☆94Updated 4 months ago
- Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024☆137Updated 5 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆113Updated 3 months ago
- ☆114Updated 6 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆120Updated 6 months ago
- This is work done by the Oxen.ai Community, trying to reproduce the Self-Rewarding Language Model paper from MetaAI.☆129Updated 8 months ago
- Tina: Tiny Reasoning Models via LoRA☆275Updated this week
- Minimal hackable GRPO implementation☆276Updated 6 months ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆468Updated last year
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆188Updated last year
- ☆143Updated last year
- ☆99Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 6 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆99Updated 2 months ago
- We present the first systematic study on the scaling property of raw agents instantiated by LLMs. We find that performance scales with th…☆128Updated 10 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆49Updated 9 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆431Updated 2 weeks ago
- ☆122Updated last year
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆121Updated 2 months ago
- Code for the paper: "Learning to Reason without External Rewards"☆345Updated last month
- ☆147Updated 8 months ago
- RL Scaling and Test-Time Scaling (ICML'25)☆110Updated 6 months ago
- [NeurIPS 2024] GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations☆64Updated 11 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆227Updated 3 weeks ago
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆250Updated 3 months ago
- Large language models for document ranking.☆64Updated 3 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆279Updated last year
- Official repository for ORPO☆462Updated last year
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆153Updated 3 weeks ago
- ☆129Updated last year