Skip to content
nuemaan / skewadamView on GitHub
Tiered optimizer state allocation for memory efficient MoE training. Cuts optimizer memory by 97.4%, outperforming AdamW/Muon/Lion while fitting a 6.78B MoE on a single 40GB GPU.
☆14Sep 10, 2026Updated 2 months ago

Alternatives and similar repositories for skewadam

Users that are interested in skewadam are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?