BlinkDL / SmallInitEmb

LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
60Updated 3 years ago

Alternatives and similar repositories for SmallInitEmb:

Users that are interested in SmallInitEmb are comparing it to the libraries listed below