liangyuwang / zo2Links
ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
☆148Updated 3 weeks ago
Alternatives and similar repositories for zo2
Users that are interested in zo2 are comparing it to the libraries listed below
Sorting:
- ☆91Updated 3 weeks ago
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆133Updated 3 months ago
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models☆142Updated last month
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆195Updated last week
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆110Updated last month
- Parameter-Efficient Fine-Tuning for Foundation Models☆73Updated 3 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆105Updated last month
- ☆154Updated 2 months ago
- ☆193Updated 2 months ago
- ☆77Updated 3 months ago
- [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…☆31Updated 2 months ago
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆287Updated last month
- Tool-Star: Empowering LLM-brained Multi-Tool Reasoner via Reinforcement Learning☆197Updated last week
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆162Updated 3 months ago
- Efficient Mixture of Experts for LLM Paper List☆79Updated 6 months ago
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆153Updated 2 months ago
- Test-time preferenece optimization (ICML 2025).☆146Updated 2 months ago
- MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search too…☆241Updated last week
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆76Updated 5 months ago
- [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.☆67Updated last month
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆188Updated 3 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆51Updated this week
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆147Updated 2 weeks ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆30Updated last month
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆80Updated last week
- ☆132Updated last month
- Extrapolating RLVR to General Domains without Verifiers☆112Updated 2 weeks ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆85Updated 3 months ago
- ☆59Updated 3 weeks ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆119Updated 2 months ago