openpsi-project / ReaLHFLinks
Super-Efficient RLHF Training of LLMs with Parameter Reallocation
☆305Updated 3 months ago
Alternatives and similar repositories for ReaLHF
Users that are interested in ReaLHF are comparing it to the libraries listed below
Sorting:
- ☆198Updated 3 months ago
- VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework☆399Updated this week
- A flexible and efficient training framework for large-scale alignment tasks☆395Updated this week
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆204Updated this week
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆245Updated 3 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆654Updated 6 months ago
- slime is a LLM post-training framework aiming for RL Scaling.☆975Updated this week
- Async pipelined version of Verl☆110Updated 3 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆238Updated 5 months ago
- ☆309Updated 2 months ago
- siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems☆130Updated last week
- Scalable toolkit for efficient model reinforcement☆558Updated this week
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆188Updated 4 months ago
- Official Repository of "Learning to Reason under Off-Policy Guidance"☆268Updated 2 weeks ago
- ☆205Updated 5 months ago
- ☆258Updated 2 months ago
- Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)☆189Updated last year
- A version of verl to support tool use☆312Updated this week
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆100Updated 3 weeks ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆229Updated 3 weeks ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆320Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆679Updated this week
- Reproducing R1 for Code with Reliable Rewards☆243Updated 3 months ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆218Updated last month
- The related works and background techniques about Openai o1☆224Updated 6 months ago
- A Comprehensive Survey on Long Context Language Modeling☆169Updated 3 weeks ago
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆537Updated 2 weeks ago
- [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"☆431Updated 9 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆234Updated 2 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆238Updated last year