Andrew-Tierno / QuantizedTransformer
Implementation of a Quantized Transformer Model
☆18Updated 5 years ago
Alternatives and similar repositories for QuantizedTransformer:
Users that are interested in QuantizedTransformer are comparing it to the libraries listed below
- Implementation of ICLR 2018 paper "Loss-aware Weight Quantization of Deep Networks"☆26Updated 5 years ago
- Implementation of NeurIPS 2019 paper "Normalization Helps Training of Quantized LSTM"☆30Updated 6 months ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated last year
- caffe implementation of single level quantization☆19Updated 6 years ago
- Codes for accepted paper "Cooperative Pruning in Cross-Domain Deep Neural Network Compression" in IJCAI 2019.☆11Updated 5 years ago
- ☆15Updated 5 years ago
- Revisiting Parameter Sharing for Automatic Neural Channel Number Search, NeurIPS 2020☆20Updated 4 years ago
- Code for paper "Continual and Multi-Task Architecture Search (ACL 2019)"☆41Updated 5 years ago
- Open Source Neural Machine Translation in PyTorch☆17Updated 5 years ago
- ☆26Updated 5 years ago
- Block Sparse movement pruning☆78Updated 4 years ago
- Codes for AAAI2019 paper: Deep Neural Network Quantization via Layer-Wise Optimization using Limited Training Data☆41Updated 6 years ago
- Implementation of ICLR 2017 paper "Loss-aware Binarization of Deep Networks"☆18Updated 5 years ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22Updated last year
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Updated 5 years ago
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆13Updated 5 years ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Updated 3 years ago
- [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …☆18Updated 3 years ago
- In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization awa…☆22Updated 3 years ago
- This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …☆32Updated last year
- [NeurIPS 2019] E2-Train: Training State-of-the-art CNNs with Over 80% Less Energy☆21Updated 5 years ago
- A Unified, Systematic Framework of Structured Weight Pruning for DNNs☆22Updated 6 years ago
- Proximal Mean-field for Neural Network Quantization☆22Updated 4 years ago
- Source code for IJCAI 2022 Long paper: Parameter-Efficient Sparsity for Large Language Models Fine-Tuning.☆13Updated 2 years ago
- source code of the paper: Robust Quantization: One Model to Rule Them All☆40Updated last year
- The collection of training tricks of binarized neural networks.☆72Updated 3 years ago
- Breaking the Curse of Space Explosion: Towards Efficient NAS with Curriculum Search☆17Updated 6 months ago
- [KDD'22] Learned Token Pruning for Transformers☆96Updated last year
- The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…☆48Updated 3 years ago
- Code for BlockSwap (ICLR 2020).☆33Updated 3 years ago