HMUNACHI / super-lazy-autograd

Hand-derived memory-efficient super lazy PyTorch VJPs for training LLMs on laptop, all using one op (bundled scaled matmuls).
119Updated 3 weeks ago

Alternatives and similar repositories for super-lazy-autograd:

Users that are interested in super-lazy-autograd are comparing it to the libraries listed below