owenliang / qwen2.5-0.5b-grpoLinks
Qwen2.5 0.5B GRPO
☆75Updated 10 months ago
Alternatives and similar repositories for qwen2.5-0.5b-grpo
Users that are interested in qwen2.5-0.5b-grpo are comparing it to the libraries listed below
Sorting:
- llm & rl☆266Updated 2 months ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆77Updated last year
- ☆133Updated last year
- 通义千问的DPO训练☆61Updated last year
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆184Updated 2 years ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆255Updated last year
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]☆198Updated 5 months ago
- ☆409Updated 11 months ago
- 青稞Talk☆184Updated this week
- pytorch distribute tutorials☆166Updated 6 months ago
- ☆125Updated last year
- Train a 1B LLM with 1T tokens from scratch by personal☆782Updated 8 months ago
- ☆85Updated 11 months ago
- 一些 LLM 方面的从零复现笔记☆241Updated 8 months ago
- LLM Tokenizer with BPE algorithm☆46Updated last year
- [COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation☆165Updated 6 months ago
- ☆208Updated 2 months ago
- 将SmolVLM2的视觉头与Qwen3-0.6B模型进行了拼接微调☆496Updated 4 months ago
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆60Updated 7 months ago
- 这是一个open-r1的复现项目,对0.5B、1.5B、3B、7B的qwen模型进行GRPO训练,观察到一些有趣的现象。☆54Updated 8 months ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆913Updated last month
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆49Updated 4 months ago
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆194Updated 4 months ago
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.☆523Updated last week
- ThinkLLM:🚀 轻量、高效的大语言模型算法实现☆115Updated 7 months ago
- 一个包含了多种主流大模型微调方案的实战代码库,基于Qwen3系列模型☆105Updated 5 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆130Updated last year
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆562Updated 10 months ago
- 从0开始,将chatgpt的技术路线跑一遍。☆271Updated last year
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆437Updated 7 months ago