liangyuwang / zo2Links
ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
☆190Updated 3 months ago
Alternatives and similar repositories for zo2
Users that are interested in zo2 are comparing it to the libraries listed below
Sorting:
- ☆108Updated 4 months ago
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆142Updated 6 months ago
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)☆155Updated last week
- Official Repository for "Glyph: Scaling Context Windows via Visual-Text Compression"☆97Updated this week
- ☆203Updated 6 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆73Updated last week
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆319Updated 4 months ago
- Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.☆158Updated last month
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆115Updated 5 months ago
- [COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation☆155Updated 3 months ago
- ☆84Updated 6 months ago
- [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…☆40Updated 5 months ago
- MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search too…☆335Updated 2 months ago
- MiroMind-M1 is a fully open-source series of reasoning language models built on Qwen-2.5, focused on advancing mathematical reasoning.☆236Updated 2 months ago
- MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources☆203Updated last month
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆64Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆157Updated 4 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆218Updated 3 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆109Updated 5 months ago
- Extrapolating RLVR to General Domains without Verifiers☆174Updated 2 months ago
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆165Updated 2 months ago
- An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.☆147Updated 3 weeks ago
- ☆71Updated 4 months ago
- Efficient Mixture of Experts for LLM Paper List☆140Updated 3 weeks ago
- [TMLR 2025] Efficient Reasoning Models: A Survey☆272Updated last week
- 青稞Talk☆151Updated last week
- Parameter-Efficient Fine-Tuning for Foundation Models☆94Updated 6 months ago
- Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".☆273Updated 8 months ago
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆421Updated 5 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆179Updated 2 years ago