Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning algorithm that enables finetuning LLMs using Forward-mode Auto Differentiation; to achieve low memory footprint, high accuracy, and fast convergence.
☆13Oct 8, 2024Updated last year
Alternatives and similar repositories for Spry
Users that are interested in Spry are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Robust Federated Learning for Large Language Models in Adversarial Wireless Environments☆16Mar 7, 2025Updated last year
- Implementation for PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs☆24Jun 6, 2024Updated 2 years ago
- [NeurIPS'23] FedL2P: Federated Learning to Personalize☆24Nov 8, 2025Updated 10 months ago
- ☆47Jun 4, 2026Updated 3 months ago
- Implementation of "Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes" (https://…☆13May 6, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The code repository for the paper“From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communications”☆35Jun 2, 2025Updated last year
- Repository for SoMeLVLM: A Large Vision Language Model for Social Media Processing☆14Oct 9, 2025Updated 11 months ago
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆13Dec 15, 2024Updated last year
- FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion (NeurIPS 2024 Spotlight)