zyushun / hessian-spectrum

Code for the paper: Why Transformers Need Adam: A Hessian Perspective
53Updated last week

Alternatives and similar repositories for hessian-spectrum:

Users that are interested in hessian-spectrum are comparing it to the libraries listed below