raghavc / LLM-RLHF-Tuning-with-PPO-and-DPOLinks
Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Alpaca, LLaMA, and LLaMA2 models.
☆174Updated last year
Alternatives and similar repositories for LLM-RLHF-Tuning-with-PPO-and-DPO
Users that are interested in LLM-RLHF-Tuning-with-PPO-and-DPO are comparing it to the libraries listed below
Sorting:
- This is work done by the Oxen.ai Community, trying to reproduce the Self-Rewarding Language Model paper from MetaAI.☆130Updated 11 months ago
- ☆116Updated 9 months ago
- Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024☆141Updated 8 months ago
- ☆122Updated last year
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆136Updated 8 months ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆470Updated last year
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆232Updated 3 months ago
- Tina: Tiny Reasoning Models via LoRA☆302Updated last month
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆190Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆147Updated last year
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)☆214Updated 2 years ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆363Updated last year
- Minimal hackable GRPO implementation☆297Updated 9 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆108Updated 3 months ago
- ☆144Updated last year
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆129Updated 5 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆347Updated 10 months ago
- augmented LLM with self reflection☆133Updated last year
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆283Updated last year
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆124Updated 5 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆248Updated 5 months ago
- minimal GRPO implementation from scratch☆98Updated 7 months ago
- Evaluating LLMs with fewer examples☆164Updated last year
- Code for the paper: "Learning to Reason without External Rewards"☆369Updated 3 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 9 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 9 months ago
- Official repository for ORPO☆463Updated last year
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆111Updated 2 weeks ago
- ☆320Updated last year
- A simple unified framework for evaluating LLMs☆254Updated 6 months ago