pixeli99 / MixLN

[ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yin, Shiwei Liu
19Updated 3 months ago

Alternatives and similar repositories for MixLN:

Users that are interested in MixLN are comparing it to the libraries listed below