Skip to content
HOWILLMAKEIT / SparrowView on GitHub
麻雀虽小。五脏俱全。基于 Decoder-only + MoE 架构的轻量级大语言模型实验项目(196M/A106M),完整覆盖 Pretrain → SFT → DPO 三阶段训练流程。支持 DeepSpeed ZeRO-1/2/3 分布式训练,提供基于 Reward Model 的自动化评测与 DPO 数据合成方案。
☆13Apr 9, 2026Updated 7 months ago

Alternatives and similar repositories for Sparrow

Users that are interested in Sparrow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?