Alternatives and similar repositories for OptimalGradCheckpointing

Users that are interested in OptimalGradCheckpointing are comparing it to the libraries listed below

• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆200Updated 2 years ago
• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆34Updated 4 years ago
• csyhhu / MetaQuant
  Codes for Accepted Paper : "MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization" in NeurIPS 2019
  ☆54Updated 5 years ago
• GATECH-EIC / CPT
  [ICLR 2021 Spotlight] "CPT: Efficient Deep Neural Network Training via Cyclic Precision" by Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yinin…
  ☆31Updated last year
• BradMcDanel / sdgp
  ☆10Updated 3 years ago
• XinDongol / DNNAC
  All about acceleration and compression of Deep Neural Networks
  ☆33Updated 5 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• yaozhewei / HAP
  ☆43Updated last year
• lottery-ticket / rewinding-iclr20-public
  ☆70Updated 5 years ago
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆28Updated 4 years ago
• facebookresearch / AlphaNet
  AlphaNet Improved Training of Supernet with Alpha-Divergence
  ☆99Updated 3 years ago
• facebookresearch / AttentiveNAS
  code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"
  ☆104Updated 3 years ago
• lucaslie / torchprune
  A research library for pytorch-based neural network pruning, compression, and more.
  ☆162Updated 2 years ago
• gatech-sysml / CompOFA
  [ICLR 2021] CompOFA: Compound Once-For-All Networks For Faster Multi-Platform Deployment
  ☆24Updated 2 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 6 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• htqin / BiBERT
  This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.
  ☆88Updated 2 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• moranshkolnik / RobustQuantization
  source code of the paper: Robust Quantization: One Model to Rule Them All
  ☆40Updated 2 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated 2 years ago
• mlzxy / qsparse
  Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules
  ☆42Updated 2 years ago
• HazyResearch / fly
  ☆209Updated 2 years ago
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆95Updated 3 years ago
• facebookresearch / NASViT
  code for NASViT
  ☆66Updated 3 years ago
• aojunzz / NM-sparsity
  ☆237Updated 2 years ago
• haolibai / APS-channel-search
  Revisiting Parameter Sharing for Automatic Neural Channel Number Search, NeurIPS 2020
  ☆21Updated 4 years ago
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆36Updated 2 years ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆20Updated 4 years ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆53Updated last year
• RAIVNLab / STR
  Soft Threshold Weight Reparameterization for Learnable Sparsity
  ☆91Updated 2 years ago