Alternatives and similar repositories for OptimalGradCheckpointing

Users that are interested in OptimalGradCheckpointing are comparing it to the libraries listed below

• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆199Updated 3 years ago
• BradMcDanel / sdgp
  ☆10Updated 3 years ago
• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆35Updated 4 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆133Updated 2 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆159Updated 2 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated 2 years ago
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆29Updated 5 years ago
• aojunzz / NM-sparsity
  ☆243Updated 3 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆137Updated 3 years ago
• XinDongol / DNNAC
  All about acceleration and compression of Deep Neural Networks
  ☆33Updated 6 years ago
• mlzxy / qsparse
  Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules
  ☆43Updated 3 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 4 years ago
• HazyResearch / fly
  ☆221Updated 2 years ago
• yaozhewei / HAP
  ☆43Updated last year
• facebookresearch / AlphaNet
  AlphaNet Improved Training of Supernet with Alpha-Divergence
  ☆100Updated 4 years ago
• csyhhu / MetaQuant
  Codes for Accepted Paper : "MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization" in NeurIPS 2019
  ☆54Updated 5 years ago
• htqin / BiBERT
  This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.
  ☆89Updated 2 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆41Updated 4 years ago
• moranshkolnik / RobustQuantization
  source code of the paper: Robust Quantization: One Model to Rule Them All
  ☆40Updated 2 years ago
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆114Updated 2 years ago
• gatech-sysml / CompOFA
  [ICLR 2021] CompOFA: Compound Once-For-All Networks For Faster Multi-Platform Deployment
  ☆25Updated 2 years ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆55Updated 4 years ago
• liuzechun / Data-Free-NAS
  Data-Free Neural Architecture Search via Recursive Label Calibration. ECCV 2022.
  ☆32Updated 3 years ago
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆37Updated 2 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆57Updated 3 years ago
• topal-team / rockmate
  ☆36Updated last year
• LiuXiaoxuanPKU / GACT-ICML
  ☆43Updated 3 years ago
• NUS-HPC-AI-Lab / LARS-ImageNet-PyTorch
  Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional acc…
  ☆38Updated 4 years ago
• facebookresearch / AttentiveNAS
  code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"
  ☆105Updated 4 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year