uclaml / SPPO
The official implementation of Self-Play Preference Optimization (SPPO)
☆515Updated 2 months ago
Alternatives and similar repositories for SPPO:
Users that are interested in SPPO are comparing it to the libraries listed below
- Codebase for Iterative DPO Using Rule-based Rewards☆230Updated this week
- A recipe for online RLHF and online iterative DPO.☆503Updated 3 months ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,158Updated this week
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆134Updated last month
- adds Sequence Parallelism into LLaMA-Factory☆437Updated last week
- Recipes to train the self-rewarding reasoning LLMs.☆207Updated last month
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆249Updated 2 weeks ago
- Recipes to train reward model for RLHF.☆1,262Updated last month
- DeepRetrieval - Hacking 🔥Real Search Engines and Text/Data Retrievers with LLM + RL☆201Updated this week
- Unified KV Cache Compression Methods for Auto-Regressive Models☆966Updated 2 months ago
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆187Updated 3 weeks ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆164Updated 3 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆709Updated this week
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆586Updated last month
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆292Updated 4 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆133Updated 2 weeks ago
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆321Updated 3 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated last week
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆176Updated last week
- APOLLO: SGD-like Memory, AdamW-level Performance☆198Updated 3 weeks ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆130Updated 3 weeks ago
- A curated list of awesome leaderboard-oriented resources for foundation models☆258Updated last month
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,268Updated this week
- Benchmarking LLMs via Uncertainty Quantification☆217Updated last year
- [ICLR 2025] The official implementation of our ICLR2025 paper "AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak…☆233Updated 2 months ago
- ☆377Updated 3 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆158Updated 6 months ago
- R1-like Computer-use Agent☆63Updated last week
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆193Updated 2 weeks ago
- Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs☆639Updated 2 months ago