pixeli99 / MixLN

Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yin, Shiwei Liu
15Updated 2 weeks ago

Alternatives and similar repositories for MixLN:

Users that are interested in MixLN are comparing it to the libraries listed below