Alternatives and similar repositories for btard:

Users that are interested in btard are comparing it to the libraries listed below

• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆53Updated 4 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 2 years ago
• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated last year
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆28Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆46Updated 11 months ago
• epfml / powergossip
  Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"
  ☆15Updated 4 years ago
• DS3Lab / CocktailSGD
  ☆25Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆58Updated 3 months ago
• facebookresearch / spartan
  Spartan is an algorithm for training sparse neural network models. This repository accompanies the paper "Spartan Differentiable Sparsity…
  ☆24Updated 2 years ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆61Updated 5 months ago
• DS3Lab / DT-FM
  ☆92Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• GuillaumeLeclerc / fastargs
  Python library for argument and configuration management
  ☆53Updated last year
• google-parfait / dataset_grouper
  Libraries for efficient and scalable group-structured dataset pipelines.
  ☆23Updated last month
• epfml / REQ
  ☆16Updated 7 months ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆47Updated 8 months ago
• topal-team / rockmate
  ☆34Updated last month
• facebookresearch / projUNN
  Fast training of unitary deep network layers from low-rank updates
  ☆28Updated 2 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆58Updated 3 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• AllanYangZhou / universal_neural_functional
  ☆48Updated 11 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆83Updated this week
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆118Updated last month
• lxuechen / ml-swissknife
  An ML research codebase built with friends :)
  ☆22Updated 4 months ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆78Updated last year
• ScalingIntelligence / CATS
  ☆23Updated 2 months ago