Astuary / SpryLinks
Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning algorithm that enables finetuning LLMs using Forward-mode Auto Differentiation; to achieve low memory footprint, high accuracy, and fast convergence.
☆12Updated last year
Alternatives and similar repositories for Spry
Users that are interested in Spry are comparing it to the libraries listed below
Sorting:
- Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]☆53Updated 8 months ago
- [ICLR 2023] Test-time Robust Personalization for Federated Learning☆55Updated 2 years ago
- This is a collection of research papers for Federated Learning for Large Language Models (FedLLM). And the repository will be continuousl…☆102Updated 5 months ago
- Personalized Federated Learning under Mixture of Distributions☆19Updated 2 years ago
- [ICLR 2023] "Combating Exacerbated Heterogeneity for Robust Models in Federated Learning"☆31Updated 2 weeks ago
- ☆31Updated last year
- [ICML 2023] FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction☆27Updated last year
- ☆33Updated 4 years ago
- ☆36Updated last month
- Code for ICLR 2023 Paper Better Generative Replay for Continual Federated Learning☆33Updated 2 years ago
- [AAAI 2024] FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning☆64Updated last year
- Federated Learning - PyTorch☆15Updated 4 years ago
- ☆18Updated last year
- ☆116Updated last year
- PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models — Federated Learning in Age of Foundation Model☆43Updated 2 years ago
- [NeurIPS 2022] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training☆42Updated 2 years ago
- ICML2022: Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning☆41Updated 3 years ago
- ☆17Updated last year
- [ICLR 2023] Multimodal Federated Learning via Contrastive Representation Ensemble☆126Updated last year
- TPAMI 2024 - Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark☆112Updated 5 months ago
- AAAI 2024 accepted paper, FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heter…☆60Updated last year
- ☆105Updated last year
- ☆17Updated 2 years ago
- Reimplmentation of Visualizing the Loss Landscape of Neural Nets with PyTorch 1.8☆30Updated 3 years ago
- [ICML 2023] Optimizing the Collaboration Structure in Cross-Silo Federated Learning. Wenxuan Bao, Haohan Wang, Jun Wu, Jingrui He.☆18Updated 2 years ago
- Global and Local Prompts Cooperation via Optimal Transport for Federated Learning☆51Updated last year
- Latest Advances on Federated LLM Learning☆90Updated 6 months ago
- CVPR 2024 accepted paper, An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in He…☆65Updated 9 months ago
- Code for the NeurIPS 2024 submission: "DAGER: Extracting Text from Gradients with Language Model Priors"☆20Updated 4 months ago
- The is the official implementation of ICCV 2023 paper "No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Syn…☆26Updated 2 years ago