Alternatives and similar repositories for btard:

Users that are interested in btard are comparing it to the libraries listed below

• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated last year
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 2 months ago
• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆54Updated 4 years ago
• epfml / powergossip
  Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"
  ☆16Updated 4 years ago
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆146Updated 5 months ago
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆47Updated last year
• FusionBrainLab / LLM-Microscope
  ☆71Updated 7 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 2 years ago
• nick11roberts / XD
  ☆11Updated 2 years ago
• epfml / REQ
  ☆17Updated 10 months ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• DS3Lab / CocktailSGD
  ☆26Updated last year
• google-parfait / dataset_grouper
  Libraries for efficient and scalable group-structured dataset pipelines.
  ☆25Updated 4 months ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆49Updated 4 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆58Updated 3 years ago
• mccrearyd / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆56Updated 3 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆36Updated 2 years ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated last week
• topal-team / rockmate
  ☆36Updated 4 months ago
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆42Updated 4 years ago
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 3 years ago
• GuillaumeLeclerc / fastargs
  Python library for argument and configuration management
  ☆53Updated 2 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago
• sjunhongshen / DASH
  ☆22Updated 2 years ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆94Updated 3 weeks ago
• rahimentezari / PermutationInvariance
  ☆23Updated 2 years ago
• JonasGeiping / fullbatchtraining
  Training vision models with full-batch gradient descent and regularization
  ☆37Updated 2 years ago