Alternatives and similar repositories for ICML-2023-DSGD-and-SAM

Users that are interested in ICML-2023-DSGD-and-SAM are comparing it to the libraries listed below

• stephane-rivaud / ForwardLocalGradient
  This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
  ☆12Updated 2 years ago
• yifanycc / AdaZeta
  [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…
  ☆12Updated 11 months ago
• TNAS-DCS / TNAS-DCS
  ☆13Updated 3 years ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆66Updated last year
• k1l1 / CoCoFL
  CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and Quantization
  ☆12Updated last year
• shams-sam / FedOptim
  Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?
  ☆14Updated 3 years ago
• pomonam / jax-influence
  A simple Jax implementation of influence functions.
  ☆18Updated last year
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆33Updated last year
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated last year
• BerivanIsik / SuRP
  Implementation of the SuRP algorithm by the authors of the AISTATS 2022 paper "An Information-Theoretic Justification for Model Pruning".…
  ☆14Updated 3 years ago
• dh7401 / T-Cal
  ☆10Updated 3 years ago
• vis-opt-group / BLO
  Bi-level Optimization for Advanced Deep Learning
  ☆47Updated 4 years ago
• NVlabs / PerAda
  Repo for the paper: PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees (CVPR 2024)
  ☆20Updated last year
• JunjieYang97 / stocBiO
  Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"
  ☆50Updated 3 years ago
• nick11roberts / XD
  ☆12Updated 3 years ago
• EricLoong / feddip
  The official code for ICDM2023 paper: ' FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization'
  ☆14Updated last year
• ucr-optml / FedNest
  Federated Bilevel Optimization
  ☆16Updated 3 years ago
• sidak / otfusion
  Model Fusion via Optimal Transport, NeurIPS 2020
  ☆151Updated 3 years ago
• allenbai01 / transformers-as-statisticians
  ☆34Updated 2 years ago
• epfml / topology-in-decentralized-learning
  Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.
  ☆13Updated 3 years ago
• liboyue / Network-Distributed-Algorithm
  Experiments for distributed optimization algorithms
  ☆84Updated 2 years ago
• epfml / quasi-global-momentum
  ☆12Updated 2 years ago
• Raiden-Zhu / Generalization-of-DSGD
  The official implementation of the paper "Topology-aware Generalization of Decentralized SGD"
  ☆37Updated 2 years ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆38Updated last year
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 4 years ago
• epfml / optML-pku
  summer school materials
  ☆46Updated 2 years ago
• facebookresearch / SecureFLCompression
  Compression primitives for uplink compression in Federated Learning that are compatible with Secure Aggregation.
  ☆10Updated 3 years ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆62Updated 2 years ago
• VITA-Group / L2O-Training-Techniques
  [NeurIPS 2020 Spotlight Oral] "Training Stronger Baselines for Learning to Optimize", Tianlong Chen*, Weiyi Zhang*, Jingyang Zhou, Shiyu …
  ☆29Updated 3 years ago
• yaoyao-liu / online-hyperparameter-optimization
  PyTorch implementation of "Online Hyperparameter Optimization for Class-Incremental Learning" (AAAI 2023 Oral)
  ☆17Updated 2 years ago