Astuary / SpryView on GitHub
Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning algorithm that enables finetuning LLMs using Forward-mode Auto Differentiation; to achieve low memory footprint, high accuracy, and fast convergence.
12Oct 8, 2024Updated last year

Alternatives and similar repositories for Spry

Users that are interested in Spry are comparing it to the libraries listed below

Sorting:

Are these results useful?