VITA-Group / WeLore

From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
42Updated 6 months ago

Alternatives and similar repositories for WeLore:

Users that are interested in WeLore are comparing it to the libraries listed below