Alternatives and similar repositories for btard

Users that are interested in btard are comparing it to the libraries listed below

• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated 2 years ago
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆149Updated last year
• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆56Updated 5 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆53Updated 4 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated 2 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 9 months ago
• DS3Lab / CocktailSGD
  ☆27Updated 2 years ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated 2 years ago
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆28Updated 2 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆31Updated 2 years ago
• microsoft / fnl_paper
  Factorized Neural Layers
  ☆30Updated 2 years ago
• FusionBrainLab / LLM-Microscope
  ☆70Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆51Updated last year
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆41Updated 5 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆60Updated 4 years ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆70Updated last year
• DS3Lab / DT-FM
  ☆93Updated 3 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆91Updated this week
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated 2 years ago
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆51Updated last year
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• epfml / LocalSGD-Code
  ☆46Updated 5 years ago
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆14Updated 2 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆36Updated 3 years ago
• epfml / REQ
  ☆18Updated last year
• HazyResearch / fly
  ☆220Updated 2 years ago
• DS3Lab / AC-SGD
  Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.
  ☆28Updated 2 years ago
• Qualcomm-AI-research / llm-surgeon
  ☆34Updated last year
• RAIVNLab / STR
  Soft Threshold Weight Reparameterization for Learnable Sparsity
  ☆90Updated 2 years ago