mit-han-lab / hardware-aware-transformersLinks
[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
☆337Updated last year
Alternatives and similar repositories for hardware-aware-transformers
Users that are interested in hardware-aware-transformers are comparing it to the libraries listed below
Sorting:
- Low Precision Arithmetic Simulation in PyTorch☆291Updated last year
- [ICML'21 Oral] I-BERT: Integer-only BERT Quantization☆266Updated 3 years ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆198Updated 3 years ago
- Simple Training and Deployment of Fast End-to-End Binary Networks☆159Updated 4 years ago
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆280Updated 2 years ago
- ☆244Updated 3 years ago
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆400Updated 4 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆635Updated 6 months ago
- Prune a model while finetuning or training.☆406Updated 3 years ago
- [ICLR 2020] Lite Transformer with Long-Short Range Attention☆611Updated last year
- ☆49Updated 4 years ago
- Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow☆168Updated 6 years ago
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆159Updated 5 years ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆283Updated last year
- Implements quantized distillation. Code for our paper "Model compression via distillation and quantization"☆336Updated last year
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆432Updated 2 years ago
- aw_nas: A Modularized and Extensible NAS Framework☆252Updated 2 months ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆114Updated 2 years ago
- ☆208Updated 4 years ago
- Quantization of Convolutional Neural networks.☆250Updated last year
- Reference implementations of popular Binarized Neural Networks☆109Updated last month
- Block-sparse primitives for PyTorch☆158Updated 4 years ago
- code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"☆105Updated 4 years ago
- A PyTorch implementation of "Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights"☆167Updated 5 years ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆453Updated 2 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆334Updated 3 years ago
- DNN quantization with outlier channel splitting (ICML'19)☆113Updated 5 years ago
- Block Sparse movement pruning☆83Updated 5 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆41Updated 4 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆263Updated 2 years ago