liangyuwang / zo2Links
ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
☆181Updated 2 months ago
Alternatives and similar repositories for zo2
Users that are interested in zo2 are comparing it to the libraries listed below
Sorting:
- ☆103Updated 3 months ago
- [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…☆38Updated 4 months ago
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models☆150Updated 3 months ago
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆139Updated 5 months ago
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆312Updated 3 months ago
- ☆198Updated 5 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆64Updated this week
- Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.☆152Updated 2 months ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆113Updated 3 months ago
- MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search too…☆310Updated 3 weeks ago
- Extrapolating RLVR to General Domains without Verifiers☆158Updated last month
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆151Updated 2 weeks ago
- MiroMind-M1 is a fully open-source series of reasoning language models built on Qwen-2.5, focused on advancing mathematical reasoning.☆227Updated last month
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆154Updated 2 months ago
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆163Updated 5 months ago
- ☆127Updated 2 weeks ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆212Updated last month
- Repo for "VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforce…☆327Updated 2 months ago
- ☆163Updated 4 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆330Updated this week
- ☆80Updated 5 months ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆85Updated 7 months ago
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆87Updated last month
- 🔧Tool-Star: Empowering LLM-brained Multi-Tool Reasoner via Reinforcement Learning☆253Updated last week
- ☆67Updated 3 months ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆87Updated 5 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆106Updated 3 months ago
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆70Updated last year
- An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.☆144Updated 5 months ago
- 🚀ReVisual-R1 is a 7B open-source multimodal language model that follows a three-stage curriculum—cold-start pre-training, multimodal rei…☆178Updated 2 months ago