Raiden-Zhu / ICML-2023-DSGD-and-SAMLinks
[ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent
☆19Updated last year
Alternatives and similar repositories for ICML-2023-DSGD-and-SAM
Users that are interested in ICML-2023-DSGD-and-SAM are comparing it to the libraries listed below
Sorting:
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆12Updated 2 years ago
- Implementation of the SuRP algorithm by the authors of the AISTATS 2022 paper "An Information-Theoretic Justification for Model Pruning".…☆14Updated 3 years ago
- A simple Jax implementation of influence functions.☆17Updated last year
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆12Updated 8 months ago
- The official code for ICDM2023 paper: ' FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization'☆13Updated last year
- Repo for the paper: PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees (CVPR 2024)☆19Updated last year
- ☆10Updated 3 years ago
- Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?☆14Updated 3 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 4 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆33Updated 9 months ago
- ☆33Updated 2 years ago
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆31Updated last year
- ☆13Updated 3 years ago
- The official implementation of the paper "Topology-aware Generalization of Decentralized SGD"☆35Updated 2 years ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Updated last year
- Federated Bilevel Optimization☆16Updated 3 years ago
- [NeurIPS2022] Where to Pay Attention in Sparse Training for Feature Selection?☆12Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆66Updated 10 months ago
- Neural Tangent Kernel Papers☆115Updated 7 months ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆49Updated 3 years ago
- Official repository of "Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models" [ICML 2023]☆20Updated 7 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago
- (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code☆15Updated 2 years ago
- ☆70Updated 8 months ago
- ☆12Updated 3 years ago
- The code for our NeurIPS 2021 paper "Kernelized Heterogeneous Risk Minimization".☆13Updated 3 years ago
- Example Code for paper "Provably Faster Algorithms for Bilevel Optimization"☆15Updated 3 years ago
- Code for "Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses"☆28Updated last year
- gradient norm penalty☆41Updated last year
- [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…☆18Updated 3 years ago