YanaiEliyahu / AdasOptimizer

ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
85Updated 3 years ago

Alternatives and similar repositories for AdasOptimizer:

Users that are interested in AdasOptimizer are comparing it to the libraries listed below