JRC1995 / DemonRangerOptimizer

Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
25Updated 4 years ago

Related projects

Alternatives and complementary repositories for DemonRangerOptimizer