yandex-research / moshpit-sgd

Related projects: ⓘ

• DS3Lab / AC-SGD
  Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.
  ☆24Updated last year
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆54Updated 3 years ago
• liamcli / darts_asha
  Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."
  ☆20Updated 4 years ago
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 4 years ago
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 2 years ago
• microsoft / fnl_paper
  Factorized Neural Layers
  ☆27Updated last year
• jack-willturner / gymnastics
  A "gym" style toolkit for building lightweight NAS systems.
  ☆13Updated 2 years ago
• hangxu0304 / DeepReduce
  A Sparse-tensor Communication Framework for Distributed Deep Learning
  ☆13Updated 2 years ago
• YuhanLiu11 / AutoFreeze
  ☆22Updated 3 years ago
• ebadrian / metadl
  NeurIPS 2021 - Few-shot learning competition
  ☆26Updated 2 years ago
• smartnets / dataloader-benchmarks
  DL Dataloader Benchmarks
  ☆18Updated last week
• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆53Updated 3 years ago
• shwinshaker / LipGrow
  An adaptive training algorithm for residual network
  ☆14Updated 4 years ago
• google-parfait / dataset_grouper
  Libraries for efficient and scalable group-structured dataset pipelines.
  ☆22Updated 5 months ago
• locuslab / intermediate_robustness
  ☆16Updated 2 years ago
• evcu / pytorchpruner
  ☆22Updated 6 years ago
• Ying1123 / llm-caching-multiplexing
  ☆17Updated last year
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆10Updated 10 months ago
• lucidrains / hopular-pytorch
  ☆21Updated this week
• usyd-fsalab / NeuralNetworkRandomness
  ☆13Updated 2 years ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 3 years ago
• yandex-research / btard
  Code for the paper "Secure Distributed Training at Scale" (ICML 2022)
  ☆14Updated 2 years ago
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated 9 months ago
• singlasahil14 / barlow
  Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction
  ☆35Updated 2 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆17Updated 4 years ago
• petuum / tuun
  Hyperparameter tuning via uncertainty modeling
  ☆46Updated 4 months ago
• VITA-Group / Sparsity-Win-Robust-Generalization
  [ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun…
  ☆37Updated 2 years ago
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆35Updated last year
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆17Updated 5 months ago
• facebookresearch / fisher_information_loss
  This code reproduces the results of the paper, "Measuring Data Leakage in Machine-Learning Models with Fisher Information"
  ☆48Updated 3 years ago