pixeli99 / MixLN

Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yin, Shiwei Liu
16Updated last month

Alternatives and similar repositories for MixLN:

Users that are interested in MixLN are comparing it to the libraries listed below