Alternatives and similar repositories for btard:

Users that are interested in btard are comparing it to the libraries listed below

• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆54Updated 4 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated last week
• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated last year
• epfml / powergossip
  Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"
  ☆16Updated 4 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 2 years ago
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆146Updated 3 months ago
• HazyResearch / fly
  ☆201Updated last year
• GuillaumeLeclerc / fastargs
  Python library for argument and configuration management
  ☆53Updated 2 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆48Updated 3 years ago
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆46Updated last year
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆36Updated last year
• epfml / LocalSGD-Code
  ☆45Updated 4 years ago
• IST-DASLab / M-FAC
  Efficient reference implementations of the static & dynamic M-FAC algorithms (for pruning and optimization)
  ☆16Updated 2 years ago
• DachengLi1 / MPCFormer
  (ICLR 2023 Spotlight) MPCFormer: fast, performant, and private transformer inference with MPC
  ☆90Updated last year
• FusionBrainLab / LLM-Microscope
  ☆71Updated 5 months ago
• AamirRaihan / SWAT
  Official implementation of Neurips 2020 "Sparse Weight Activation Training" paper.
  ☆27Updated 3 years ago
• epfml / REQ
  ☆17Updated 8 months ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated this week
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• jiaweizzhao / signSGD-with-Majority-Vote
  ☆74Updated 5 years ago
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆46Updated 3 months ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• DS3Lab / DT-FM
  ☆92Updated 2 years ago
• facebookresearch / spartan
  Spartan is an algorithm for training sparse neural network models. This repository accompanies the paper "Spartan Differentiable Sparsity…
  ☆24Updated 2 years ago
• spcl / sten
  Sparsity support for PyTorch
  ☆33Updated this week
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆48Updated 9 months ago
• yxli2123 / LoSparse
  ☆49Updated last year
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆42Updated 4 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago