Alternatives and similar repositories for btard

Users that are interested in btard are comparing it to the libraries listed below

• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 3 months ago
• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆54Updated 4 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 2 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆50Updated 4 years ago
• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated last year
• epfml / powergossip
  Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"
  ☆16Updated 4 years ago
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆36Updated 2 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• rollovd / LookSAM
  This is unofficial repository for Towards Efficient and Scalable Sharpness-Aware Minimization.
  ☆36Updated last year
• FusionBrainLab / LLM-Microscope
  ☆71Updated 8 months ago
• DS3Lab / CocktailSGD
  ☆27Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆47Updated last year
• facebookresearch / spartan
  Spartan is an algorithm for training sparse neural network models. This repository accompanies the paper "Spartan Differentiable Sparsity…
  ☆24Updated 2 years ago
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆47Updated 6 months ago
• microsoft / fnl_paper
  Factorized Neural Layers
  ☆27Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆45Updated 2 years ago
• pnnl / torchntk
  ☆27Updated 2 years ago
• naver / force
  ☆14Updated 4 years ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆67Updated 9 months ago
• tml-epfl / sgd-sparse-features
  SGD with large step sizes learns sparse features [ICML 2023]
  ☆32Updated 2 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• MarlonBecker / MSAM
  ☆18Updated last year
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆147Updated 6 months ago
• xingchenwan / MLRG_DeepCurvature
  ☆15Updated 5 years ago
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 3 years ago
• epfml / REQ
  ☆17Updated 11 months ago
• nick11roberts / XD
  ☆11Updated 2 years ago
• gibipara92 / learning-explanations-hard-to-vary
  Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …
  ☆39Updated 4 years ago
• JonasGeiping / fullbatchtraining
  Training vision models with full-batch gradient descent and regularization
  ☆37Updated 2 years ago
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆28Updated last year