EsterHlav / Dynamical-Isometry-from-Orthogonality-Neural-Nets

Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthogonal regularizer on RNNs with SeqMNIST dataset.
17Updated 5 years ago

Alternatives and similar repositories for Dynamical-Isometry-from-Orthogonality-Neural-Nets:

Users that are interested in Dynamical-Isometry-from-Orthogonality-Neural-Nets are comparing it to the libraries listed below