liangyuwang / zo2Links
ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
☆194Updated 4 months ago
Alternatives and similar repositories for zo2
Users that are interested in zo2 are comparing it to the libraries listed below
Sorting:
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆144Updated 7 months ago
- ☆205Updated 2 weeks ago
- ☆110Updated 5 months ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆118Updated 5 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆76Updated this week
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)☆167Updated last week
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆328Updated 5 months ago
- Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.☆160Updated last month
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆159Updated 4 months ago
- MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search too…☆347Updated 2 months ago
- ☆85Updated 7 months ago
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆170Updated 2 months ago
- Towards a Unified View of Large Language Model Post-Training☆183Updated 2 months ago
- ☆52Updated 3 months ago
- MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources☆208Updated last month
- MiroMind-M1 is a fully open-source series of reasoning language models built on Qwen-2.5, focused on advancing mathematical reasoning.☆240Updated 3 months ago
- [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…☆40Updated 6 months ago
- Efficient Mixture of Experts for LLM Paper List☆143Updated last month
- Scaling Preference Data Curation via Human-AI Synergy☆126Updated 4 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆222Updated 3 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆398Updated this week
- [COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation☆161Updated 4 months ago
- ☆163Updated last month
- 青稞Talk☆160Updated last week
- One-shot Entropy Minimization☆187Updated 5 months ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆91Updated this week
- ☆170Updated this week
- ICML2025: Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning☆51Updated 6 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆180Updated 2 years ago
- Repo for "VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforce…☆391Updated last month