Astuary / SpryLinks
Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning algorithm that enables finetuning LLMs using Forward-mode Auto Differentiation; to achieve low memory footprint, high accuracy, and fast convergence.
☆12Updated last year
Alternatives and similar repositories for Spry
Users that are interested in Spry are comparing it to the libraries listed below
Sorting:
- Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]☆52Updated 8 months ago
- Personalized Federated Learning under Mixture of Distributions☆19Updated last year
- Federated Learning - PyTorch☆15Updated 4 years ago
- Code for ICLR 2023 Paper Better Generative Replay for Continual Federated Learning☆32Updated 2 years ago
- ☆36Updated last week
- This is a collection of research papers for Federated Learning for Large Language Models (FedLLM). And the repository will be continuousl…☆101Updated 5 months ago
- ☆103Updated 11 months ago
- ☆33Updated 4 years ago
- ☆114Updated last year
- ☆32Updated last year
- [AAAI 2024] FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning☆63Updated last year
- [ICML 2023] FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction☆27Updated last year
- ☆17Updated 2 years ago
- [ICLR 2023] Test-time Robust Personalization for Federated Learning☆54Updated 2 years ago
- Official repository for Towards Multi-modal Transformers in Federated Learning (ECCV2024)☆19Updated 10 months ago
- [NeurIPS 2023] "FedFed: Feature Distillation against Data Heterogeneity in Federated Learning"☆22Updated 2 years ago
- [CVPRW 2023] "Many-Task Federated Learning: A New Problem Setting and A Simple Baseline" by Ruisi Cai, Xiaohan Chen, Shiwei Liu, Jayanth …☆13Updated 2 years ago
- [ICLR 2023] "Combating Exacerbated Heterogeneity for Robust Models in Federated Learning"☆31Updated 2 years ago
- Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?☆14Updated 3 years ago
- Latest Advances on Federated LLM Learning☆84Updated 5 months ago
- [ICLR 2023] Multimodal Federated Learning via Contrastive Representation Ensemble☆124Updated 11 months ago
- TPAMI 2024 - Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark☆111Updated 4 months ago
- ☆29Updated 2 years ago
- PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models — Federated Learning in Age of Foundation Model☆43Updated 2 years ago
- AAAI 2024 accepted paper, FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heter…☆60Updated 11 months ago
- Benchmark for Hetergeneous Federated Learning by MARS Group at the Wuhan University, led by Prof. Mang Ye.☆19Updated 2 years ago
- The is the official implementation of ICCV 2023 paper "No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Syn…☆26Updated 2 years ago
- PyTorch code for our paper "Resource-Adaptive Federated Learning with All-In-One Neural Composition" (NeurIPS2022)☆19Updated 3 years ago
- ☆19Updated last year
- PFLoRA-lib: Personalized Federated Learning with LoRA Algorithm Library focusing on privacy-protection, federated-learning, Citation, Ext…☆14Updated last year