uclaml / SPPOLinks
The official implementation of Self-Play Preference Optimization (SPPO)
☆565Updated 4 months ago
Alternatives and similar repositories for SPPO
Users that are interested in SPPO are comparing it to the libraries listed below
Sorting:
- Codebase for Iterative DPO Using Rule-based Rewards☆246Updated last month
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,185Updated 2 months ago
- A recipe for online RLHF and online iterative DPO.☆514Updated 5 months ago
- adds Sequence Parallelism into LLaMA-Factory☆504Updated last week
- Unified KV Cache Compression Methods for Auto-Regressive Models☆1,108Updated 5 months ago
- DeepRetrieval - 🔥 Training Search Agent with Retrieval Outcomes via Reinforcement Learning☆537Updated last week
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆159Updated 3 months ago
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆691Updated last month
- Recipes to train the self-rewarding reasoning LLMs.☆222Updated 3 months ago
- APOLLO: SGD-like Memory, AdamW-level Performance☆234Updated last month
- ☆196Updated 3 weeks ago
- Recipes to train reward model for RLHF.☆1,356Updated last month
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆258Updated 2 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆136Updated 2 months ago
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆301Updated 6 months ago
- When Agent Becomes the Scientist – Building Closed-Loop System from Hypothesis to Verification☆276Updated this week
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆723Updated 3 weeks ago
- R1-like Computer-use Agent☆74Updated 2 months ago
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆201Updated last month
- [ICLR 2025] BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments☆36Updated 3 months ago
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆229Updated this week
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆177Updated last month
- Train your Agent model via our easy and efficient framework☆957Updated this week
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆140Updated 2 weeks ago
- From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery☆138Updated this week
- Official code of paper "Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Models"☆74Updated last week
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆210Updated 2 months ago
- Benchmarking LLMs via Uncertainty Quantification☆230Updated last year
- [ICLR 2025 Spotlight] The official implementation of our ICLR2025 paper "AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to…☆260Updated last month
- Pytorch Library for Relational Table Learning with LLMs.☆429Updated 2 weeks ago