ElleLeonne / Lightning-ReLoRA

A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
33Updated last year

Alternatives and similar repositories for Lightning-ReLoRA:

Users that are interested in Lightning-ReLoRA are comparing it to the libraries listed below