Astuary / SpryLinks
Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning algorithm that enables finetuning LLMs using Forward-mode Auto Differentiation; to achieve low memory footprint, high accuracy, and fast convergence.
☆12Updated last year
Alternatives and similar repositories for Spry
Users that are interested in Spry are comparing it to the libraries listed below
Sorting:
- Personalized Federated Learning under Mixture of Distributions☆19Updated 2 years ago
- This is a collection of research papers for Federated Learning for Large Language Models (FedLLM). And the repository will be continuousl…☆103Updated 6 months ago
- Code for ICLR 2023 Paper Better Generative Replay for Continual Federated Learning☆33Updated 2 years ago
- Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]☆57Updated 9 months ago
- Federated Learning - PyTorch☆15Updated 4 years ago
- [ICML 2023] FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction☆27Updated last year
- ☆33Updated 4 years ago
- [ICLR 2023] Test-time Robust Personalization for Federated Learning☆55Updated 2 years ago
- AAAI 2024 accepted paper, FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heter…☆62Updated last year
- ☆18Updated last year
- ☆110Updated last year
- Benchmark for Hetergeneous Federated Learning by MARS Group at the Wuhan University, led by Prof. Mang Ye.☆19Updated 2 years ago
- ☆29Updated 2 years ago
- ☆30Updated last year
- ☆38Updated 2 months ago
- ☆117Updated last year
- The is the official implementation of ICCV 2023 paper "No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Syn…☆27Updated 2 years ago
- Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?☆15Updated 3 years ago
- [AAAI 2024] FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning☆64Updated 2 years ago
- TPAMI 2024 - Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark☆110Updated 6 months ago
- [ICLR 2023] "Combating Exacerbated Heterogeneity for Robust Models in Federated Learning"☆31Updated last month
- ICML2022: Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning☆41Updated 3 years ago
- Towards Addressing Label Skews in One-Shot Federated Learning (ICLR 2023)☆17Updated 2 years ago
- Latest Advances on Federated LLM Learning☆97Updated 7 months ago
- [NeurIPS'22 Spotlight] Federated Learning from Pre-Trained Models: A Contrastive Learning Approach☆43Updated 2 years ago
- The is the official implementation of ICML 2023 paper "Revisiting Weighted Aggregation in Federated Learning with Neural Networks".☆61Updated 2 years ago
- Code Implementation and Informations about FedAS☆32Updated last year
- PyTorch code for our paper "Resource-Adaptive Federated Learning with All-In-One Neural Composition" (NeurIPS2022)☆19Updated 3 years ago
- [NeurIPS 2022] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training☆42Updated 2 years ago
- [ICLR2023] Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning (https://arxiv.org/abs/2210.0022…☆40Updated 3 years ago