uclaml / SPPOLinks
The official implementation of Self-Play Preference Optimization (SPPO)
☆582Updated 9 months ago
Alternatives and similar repositories for SPPO
Users that are interested in SPPO are comparing it to the libraries listed below
Sorting:
- ☆918Updated this week
- ☆323Updated 2 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆261Updated 7 months ago
- A recipe for online RLHF and online iterative DPO.☆536Updated 10 months ago
- [NIPS'25 Spotlight] Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,224Updated 2 months ago
- adds Sequence Parallelism into LLaMA-Factory☆591Updated last month
- Recipes to train the self-rewarding reasoning LLMs.☆227Updated 8 months ago
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆555Updated 3 months ago
- [EMNLP'25] s3 - ⚡ Efficient & Effective Search Agent Training via RL for RAG (RLVR for Search with Minimal Data)☆786Updated 2 weeks ago
- (ICML'25 Outstanding) CollabLLM: From Passive Responders to Active Collaborators☆256Updated last month
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆255Updated 3 months ago
- ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.098…☆304Updated 3 months ago
- ☆248Updated 6 months ago
- [COLM’25] DeepRetrieval — 🔥 The First Search Agent Trained by On-Policy Reinforcement Learning☆671Updated last month
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆138Updated 8 months ago
- Tree Search for LLM Agent Reinforcement Learning☆241Updated last month
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆289Updated 2 months ago
- A scalable, end-to-end training pipeline for general-purpose agents☆361Updated 4 months ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆160Updated 6 months ago
- R1-like Computer-use Agent☆87Updated 8 months ago
- Recipes to train reward model for RLHF.☆1,480Updated 6 months ago
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆275Updated 8 months ago
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model(1.7B, 4B, 8B, 30B)☆282Updated last month
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆713Updated 3 weeks ago
- (NeurIPS 2024) AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning☆231Updated 5 months ago
- Unified KV Cache Compression Methods for Auto-Regressive Models☆1,277Updated 10 months ago
- Official code of paper "Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Models"☆82Updated 5 months ago
- A library for generating difficulty-scalable, multi-tool, and verifiable agentic tasks with execution trajectories.☆167Updated 4 months ago
- ☆505Updated 2 months ago
- Uni-MoE: Lychee's Large Multimodal Model Family.☆917Updated this week