Alternatives and similar repositories for M-FAC

Users that are interested in M-FAC are comparing it to the libraries listed below

• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆149Updated last year
• epfml / LocalSGD-Code
  ☆46Updated 5 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆53Updated 4 years ago
• HazyResearch / fly
  ☆222Updated 2 years ago
• alecwangcq / GraSP
  Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH
  ☆105Updated 5 years ago
• NUS-HPC-AI-Lab / LARS-ImageNet-PyTorch
  Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional acc…
  ☆38Updated 4 years ago
• JYWa / Overlap_Local_SGD
  Implementation of (overlap) local SGD in Pytorch
  ☆34Updated 5 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 4 years ago
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆45Updated 2 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆83Updated 5 years ago
• RAIVNLab / STR
  Soft Threshold Weight Reparameterization for Learnable Sparsity
  ☆91Updated 2 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆74Updated 5 years ago
• dhroth / sketchedsgd
  Sketched SGD
  ☆28Updated 5 years ago
• ganguli-lab / Synaptic-Flow
  ☆228Updated last year
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated 2 years ago
• namhoonlee / snip-public
  SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY
  ☆116Updated 6 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆158Updated 4 years ago
• nsfzyzz / loss_landscape_taxonomy
  [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228
  ☆20Updated 4 years ago
• LiuXiaoxuanPKU / GACT-ICML
  ☆43Updated 3 years ago
• facebookresearch / stochastic_gradient_push
  Stochastic Gradient Push for Distributed Deep Learning
  ☆170Updated 2 years ago
• lucaslie / torchprune
  A research library for pytorch-based neural network pruning, compression, and more.
  ☆162Updated 3 years ago
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆60Updated 4 years ago
• jianweif / OptimalGradCheckpointing
  ☆41Updated 4 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆94Updated last week
• allenai / hidden-networks
  ☆194Updated 3 weeks ago
• lolemacs / continuous-sparsification
  Implementation of Continuous Sparsification, a method for pruning and ticket search in deep networks
  ☆34Updated 3 years ago
• D-X-Y / NATS-Bench
  TPAMI 2021: NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size
  ☆189Updated 3 years ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated 2 years ago
• slowbull / DDG
  A PyTorch implementation of the paper "Decoupled Parallel Backpropagation with Convergence Guarantee"
  ☆30Updated 7 years ago
• jiaweizzhao / signSGD-with-Majority-Vote
  ☆77Updated 6 years ago