Alternatives and similar repositories for btard

Users that are interested in btard are comparing it to the libraries listed below

• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆148Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆50Updated last year
• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated 2 years ago
• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆56Updated 4 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆53Updated 4 years ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated 2 years ago
• DS3Lab / CocktailSGD
  ☆26Updated 2 years ago
• DS3Lab / DT-FM
  ☆93Updated 3 years ago
• GuillaumeLeclerc / fastargs
  Python library for argument and configuration management
  ☆55Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated 2 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 8 months ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated 2 years ago
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆41Updated 4 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆91Updated this week
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• bbartoldson / GeneralizationStabilityTradeoff
  Experiments from "The Generalization-Stability Tradeoff in Neural Network Pruning": https://arxiv.org/abs/1906.03728.
  ☆14Updated 5 years ago
• sidak / otfusion
  Model Fusion via Optimal Transport, NeurIPS 2020
  ☆151Updated 2 years ago
• epfml / REQ
  ☆18Updated last year
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆110Updated this week
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆31Updated 2 years ago
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• FusionBrainLab / LLM-Microscope
  ☆70Updated last year
• locuslab / edge-of-stability
  ☆71Updated 10 months ago
• google-research / dp-imagenet
  ☆37Updated 3 years ago
• Qualcomm-AI-research / llm-surgeon
  ☆33Updated last year
• VITA-Group / ToST
  [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang
  ☆30Updated 3 years ago
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆60Updated 3 years ago
• LIONS-EPFL / scion
  ☆45Updated last week
• js-d / sim_metric
  ☆37Updated 2 years ago
• DS3Lab / AC-SGD
  Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.
  ☆27Updated 2 years ago