mit-han-lab / hardware-aware-transformers

Related projects ⓘ

Alternatives and complementary repositories for hardware-aware-transformers

• Tiiiger / QPyTorch
  Low Precision Arithmetic Simulation in PyTorch
  ☆265Updated 6 months ago
• kssteven418 / I-BERT
  [ICML'21 Oral] I-BERT: Integer-only BERT Quantization
  ☆229Updated last year
• jwfromm / Riptide
  Simple Training and Deployment of Fast End-to-End Binary Networks
  ☆159Updated 2 years ago
• mit-han-lab / haq
  [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision
  ☆370Updated 3 years ago
• Xilinx / graffitist
  Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow
  ☆168Updated 4 years ago
• Zhen-Dong / HAWQ
  Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.
  ☆413Updated last year
• Qualcomm-AI-research / transformer-quantization
  ☆195Updated 3 years ago
• antspy / quantized_distillation
  Implements quantized distillation. Code for our paper "Model compression via distillation and quantization"
  ☆330Updated 3 months ago
• amirgholami / ZeroQ
  [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework
  ☆274Updated 11 months ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆201Updated last year
• mit-han-lab / lite-transformer
  [ICLR 2020] Lite Transformer with Long-Short Range Attention
  ☆599Updated 4 months ago
• yhhhli / APoT_Quantization
  PyTorch implementation for the APoT quantization (ICLR 2020)
  ☆268Updated 2 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆148Updated 3 years ago
• mit-han-lab / apq
  [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy
  ☆156Updated 4 years ago
• ChanChiChoi / awesome-model-compression
  papers about model compression
  ☆165Updated last year
• chester256 / Model-Compression-Papers
  Papers for deep neural network compression and acceleration
  ☆396Updated 3 years ago
• submission2019 / cnn-quantization
  Quantization of Convolutional Neural networks.
  ☆239Updated 3 months ago
• microsoft / LQ-Nets
  LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
  ☆239Updated 2 years ago
• aojunzz / NM-sparsity
  ☆214Updated 2 years ago
• jakc4103 / DFQ
  PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.
  ☆258Updated last year
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆607Updated 3 years ago
• GATECH-EIC / HW-NAS-Bench
  [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark
  ☆105Updated last year
• cedrickchee / awesome-ml-model-compression
  Awesome machine learning model compression research papers, quantization, tools, and learning material.
  ☆491Updated 2 months ago
• larq / zoo
  Reference implementations of popular Binarized Neural Networks
  ☆104Updated 3 weeks ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆571Updated 6 months ago
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆394Updated 2 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 3 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆296Updated 3 years ago
• facebookresearch / AttentiveNAS
  code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"
  ☆103Updated 3 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 3 years ago