Raiden-Zhu / ICML-2023-DSGD-and-SAM

Related projects ⓘ

Alternatives and complementary repositories for ICML-2023-DSGD-and-SAM

• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆24Updated 2 weeks ago
• streethagore / ForwardLocalGradient
  This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
  ☆10Updated last year
• EricLoong / feddip
  The official code for ICDM2023 paper: ' FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization'
  ☆9Updated 3 months ago
• TNAS-DCS / TNAS-DCS
  ☆12Updated 2 years ago
• pomonam / jax-influence
  A simple Jax implementation of influence functions.
  ☆16Updated 7 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆43Updated last month
• facebookresearch / where_to_begin
  Repo to reproduce results for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
  ☆25Updated last year
• epfml / topology-in-decentralized-learning
  Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.
  ☆11Updated 2 years ago
• dh7401 / T-Cal
  ☆10Updated 2 years ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆30Updated 8 months ago
• Thinklab-SJTU / GAMF
  ☆17Updated last year
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆11Updated 3 months ago
• meghdadk / SCRUB
  ☆38Updated 3 months ago
• reds-lab / projektor
  This is an official repository for "Performance Scaling via Optimal Transport: Enabling Data Selection from Partially Revealed Sources" (…
  ☆11Updated last year
• grigorisg9gr / regularized_polynomials
  Official Implementation of the CVPR'23 paper 'Regularization of polynomial networks for image recognition'.
  ☆9Updated last year
• epfml / optML-pku
  summer school materials
  ☆45Updated last year
• mariuslindegaard / Intermediate_Neural_Collapse
  (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code
  ☆13Updated last year
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆36Updated last year
• chrhenning / posterior_replay_cl
  Continual learning of task-specific approximations of the parameter posterior distribution via a shared hypernetwork.
  ☆16Updated 2 weeks ago
• nsfzyzz / loss_landscape_taxonomy
  [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228
  ☆18Updated 2 years ago
• litian96 / AdaDPS
  Private Adaptive Optimization with Side Information (ICML '22)
  ☆16Updated 2 years ago
• YiteWang / NTK-SAP
  [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics
  ☆18Updated last year
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆73Updated 4 months ago
• allenbai01 / transformers-as-statisticians
  ☆26Updated last year
• insuhan / ntk-sketch-rf
  Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features
  ☆14Updated 2 years ago
• VITA-Group / ToST
  [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang
  ☆26Updated 2 years ago
• mil-ad / prospr
  Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients
  ☆30Updated 2 years ago
• huangtiansheng / fedslr
  ☆9Updated last year
• Cranial-XIX / Continual-Learning-Private-Unlearning
  Official PyTorch Implementation for Continual Learning and Private Unlearning
  ☆13Updated 2 years ago
• zhaoyang-0204 / gnp
  gradient norm penalty
  ☆38Updated 5 months ago