Raiden-Zhu / ICML-2023-DSGD-and-SAMLinks
[ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent
☆19Updated last year
Alternatives and similar repositories for ICML-2023-DSGD-and-SAM
Users that are interested in ICML-2023-DSGD-and-SAM are comparing it to the libraries listed below
Sorting:
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆32Updated last year
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆12Updated 2 years ago
- [NeurIPS 2020 Spotlight Oral] "Training Stronger Baselines for Learning to Optimize", Tianlong Chen*, Weiyi Zhang*, Jingyang Zhou, Shiyu …☆28Updated 3 years ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆50Updated 3 years ago
- The code for our NeurIPS 2021 paper "Kernelized Heterogeneous Risk Minimization".☆13Updated 4 years ago
- Code for "Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses"☆31Updated last year
- Official PyTorch implementation of NeuralSVD (ICML 2024)☆20Updated last year
- A simple Jax implementation of influence functions.☆18Updated last year
- Neural Tangent Kernel Papers☆119Updated 10 months ago
- ☆17Updated 3 years ago
- Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?☆14Updated 3 years ago
- ☆72Updated 11 months ago
- Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.☆13Updated 3 years ago
- ☆13Updated 3 years ago
- ☆28Updated 2 years ago
- (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code☆15Updated 2 years ago
- ☆10Updated 3 years ago
- Model Fusion via Optimal Transport, NeurIPS 2020☆151Updated 3 years ago
- ☆15Updated 2 years ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆35Updated last year
- Libraries for efficient and scalable group-structured dataset pipelines.☆25Updated 5 months ago
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Updated last year
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆65Updated last year
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆37Updated 2 years ago
- Code Repository for the NeurIPS 2021 paper: "Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic P…☆21Updated last year
- Bi-level Optimization for Advanced Deep Learning☆47Updated 3 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated 2 years ago
- Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine"☆73Updated last year
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆12Updated 11 months ago
- Example Code for paper "Provably Faster Algorithms for Bilevel Optimization"☆15Updated 3 years ago