jianweif / OptimalGradCheckpointing

Related projects: ⓘ

• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆35Updated 3 years ago
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆26Updated 3 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆196Updated last year
• cli99 / flops-profiler
  pytorch-profiler
  ☆47Updated last year
• LiuXiaoxuanPKU / GACT-ICML
  ☆39Updated last year
• yaozhewei / HAP
  ☆42Updated 7 months ago
• IST-DASLab / OBC
  Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".
  ☆95Updated last year
• Zhen-Dong / BitPack
  BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.
  ☆49Updated last year
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆73Updated 3 months ago
• GATECH-EIC / CPT
  [ICLR 2021] "CPT: Efficient Deep Neural Network Training via Cyclic Precision" by Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yining Ding, Vi…
  ☆30Updated 6 months ago
• bohanzhuang / Towards-Effective-Low-bitwidth-Convolutional-Neural-Networks
  This repository implements the paper "Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations"
  ☆20Updated 3 years ago
• csyhhu / MetaQuant
  Codes for Accepted Paper : "MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization" in NeurIPS 2019
  ☆55Updated 4 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆129Updated last year
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆45Updated 9 months ago
• facebookresearch / AttentiveNAS
  code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"
  ☆103Updated 2 years ago
• ziplab / QTool
  Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)
  ☆68Updated 2 years ago
• aojunzz / NM-sparsity
  ☆212Updated last year
• BradMcDanel / sdgp
  ☆11Updated 2 years ago
• lightmatter-ai / INT-FP-QSim
  Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.
  ☆42Updated last year
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆172Updated 11 months ago
• gilshm / sparq
  Post-training sparsity-aware quantization
  ☆32Updated last year
• Qualcomm-AI-research / oscillations-qat
  ☆67Updated 2 years ago
• htqin / BiBERT
  This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.
  ☆81Updated last year
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆98Updated last year
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆54Updated 3 years ago
• AamirRaihan / SWAT
  Official implementation of Neurips 2020 "Sparse Weight Activation Training" paper.
  ☆26Updated 3 years ago
• xiusu / NAS-Bench-Macro
  NAS Benchmark in "Prioritized Architecture Sampling with Monto-Carlo Tree Search", CVPR2021
  ☆38Updated 3 years ago
• FLHonker / ZAQ-code
  CVPR 2021 : Zero-shot Adversarial Quantization (ZAQ)
  ☆65Updated 2 years ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆46Updated last year
• mlzxy / qsparse
  Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules
  ☆40Updated 2 years ago