mit-han-lab / hardware-aware-transformers
[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
☆331Updated 7 months ago
Alternatives and similar repositories for hardware-aware-transformers:
Users that are interested in hardware-aware-transformers are comparing it to the libraries listed below
- [ICML'21 Oral] I-BERT: Integer-only BERT Quantization☆238Updated 2 years ago
- Low Precision Arithmetic Simulation in PyTorch☆272Updated 9 months ago
- [ICLR 2020] Lite Transformer with Long-Short Range Attention☆606Updated 7 months ago
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆157Updated 4 years ago
- Simple Training and Deployment of Fast End-to-End Binary Networks☆158Updated 3 years ago
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆275Updated last year
- PyTorch implementation for the APoT quantization (ICLR 2020)☆271Updated 2 months ago
- ☆199Updated 3 years ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆426Updated last year
- A general and accurate MACs / FLOPs profiler for PyTorch models☆596Updated 9 months ago
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆379Updated 3 years ago
- Prune a model while finetuning or training.☆399Updated 2 years ago
- ☆220Updated 2 years ago
- A PyTorch implementation of "Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights"☆167Updated 4 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆260Updated last year
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆109Updated last year
- Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow☆168Updated 5 years ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆201Updated 2 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆298Updated 3 years ago
- Papers for deep neural network compression and acceleration☆396Updated 3 years ago
- Reference implementations of popular Binarized Neural Networks☆107Updated this week
- Quantization of Convolutional Neural networks.☆243Updated 6 months ago
- Implements quantized distillation. Code for our paper "Model compression via distillation and quantization"☆332Updated 6 months ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆160Updated 4 years ago
- papers about model compression☆167Updated 2 years ago
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆428Updated last year
- Repository to track the progress in model compression and acceleration☆105Updated 3 years ago
- This repo contains the official Pytorch reimplementation of the paper "NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Appl…☆183Updated last year
- The PyTorch implementation of Learned Step size Quantization (LSQ) in ICLR2020 (unofficial)☆128Updated 4 years ago
- code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"☆104Updated 3 years ago