CERT-Lab / fed-sb
Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning
☆12Updated 2 months ago
Alternatives and similar repositories for fed-sb:
Users that are interested in fed-sb are comparing it to the libraries listed below
- Federated Transformer (NeurIPS 24): a framework to enhance the performance of multi-party Vertical Federated Learning involving fuzzy ide…☆38Updated 4 months ago
- ☆74Updated 4 months ago
- Mobile Federated Learning development kit for FedCampus☆16Updated last year
- [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things☆55Updated 8 months ago
- FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models☆12Updated 3 months ago
- ☆24Updated 2 months ago
- CVPR 2024 accepted paper, An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in He…☆56Updated last month
- This is a collection of research papers for Federated Learning for Large Language Models (FedLLM). And the repository will be continuousl…☆88Updated 3 months ago
- An official implementation of "FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model", which has been accepted by KDD'2…☆44Updated 2 months ago
- Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆36Updated 3 months ago
- ☆63Updated last year
- AAAI 2024 accepted paper, FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heter…☆49Updated 4 months ago
- [CVPR 2024] Official Repository for "FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuning"☆21Updated 6 months ago
- ☆32Updated last year
- ☆9Updated 2 years ago
- This is the official implementation of the IJCAI 2024 paper "FedPFT: Federated Proxy Fine-Tuning of Foundation Models".☆22Updated last year
- [ICLR 2024] FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices Using a Computing Power-Aware Scheduler☆16Updated last year
- Pytorch Code for FedHyper☆10Updated 8 months ago
- Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]☆32Updated 3 weeks ago
- Implementation for PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs☆22Updated 11 months ago
- ☆44Updated 5 months ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆88Updated 11 months ago
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆33Updated 2 months ago
- ☆22Updated last year
- The implement of FedCyBGD☆11Updated 9 months ago
- Code for ScaleFL☆31Updated 2 years ago
- Latest Advances on Federated LLM Learning☆42Updated last month
- ✨✨A curated list of latest advances on Large Foundation Models with Federated Learning☆108Updated last month
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆33Updated last year
- [NeurIPS 2022] "FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction" by Samiul Alam, Luyang Liu, Ming Yan,…☆61Updated 8 months ago