Alternatives and similar repositories for OptimalGradCheckpointing:

Users that are interested in OptimalGradCheckpointing are comparing it to the libraries listed below

• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆34Updated 4 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated last year
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆28Updated 4 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆200Updated 2 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated last year
• moranshkolnik / RobustQuantization
  source code of the paper: Robust Quantization: One Model to Rule Them All
  ☆40Updated 2 years ago
• BradMcDanel / sdgp
  ☆10Updated 3 years ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• GATECH-EIC / CPT
  [ICLR 2021 Spotlight] "CPT: Efficient Deep Neural Network Training via Cyclic Precision" by Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yinin…
  ☆30Updated last year
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆47Updated last year
• LiuXiaoxuanPKU / GACT-ICML
  ☆42Updated 2 years ago
• yaozhewei / HAP
  ☆43Updated last year
• csyhhu / MetaQuant
  Codes for Accepted Paper : "MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization" in NeurIPS 2019
  ☆54Updated 4 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• Zhen-Dong / BitPack
  BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.
  ☆52Updated 2 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆130Updated 3 years ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆52Updated last year
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆86Updated 3 months ago
• htqin / BiBERT
  This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.
  ☆88Updated last year
• facebookresearch / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆71Updated 2 years ago
• megvii-research / SSQL-ECCV2022
  PyTorch implementation of SSQL (Accepted to ECCV2022 oral presentation)
  ☆74Updated 2 years ago
• Qualcomm-AI-research / gptvq
  ☆29Updated last year
• bohanzhuang / Towards-Effective-Low-bitwidth-Convolutional-Neural-Networks
  This repository implements the paper "Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations"
  ☆20Updated 3 years ago
• Intelligent-Computing-Lab-Yale / GPTQv2
  Code implementation of GPTQv2 (https://arxiv.org/abs/2504.02692)
  ☆29Updated last week
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• ModelTC / NNLQP
  ☆35Updated 2 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 5 years ago
• mlzxy / qsparse
  Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules
  ☆41Updated 2 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆106Updated last year