Andrew-Tierno / QuantizedTransformerLinks
Implementation of a Quantized Transformer Model
☆19Updated 6 years ago
Alternatives and similar repositories for QuantizedTransformer
Users that are interested in QuantizedTransformer are comparing it to the libraries listed below
Sorting:
- Implementation of ICLR 2018 paper "Loss-aware Weight Quantization of Deep Networks"☆26Updated 5 years ago
- Implementation of NeurIPS 2019 paper "Normalization Helps Training of Quantized LSTM"☆31Updated last year
- Codes for AAAI2019 paper: Deep Neural Network Quantization via Layer-Wise Optimization using Limited Training Data☆41Updated 6 years ago
- [KDD'22] Learned Token Pruning for Transformers☆98Updated 2 years ago
- Block Sparse movement pruning☆81Updated 4 years ago
- source code of the paper: Robust Quantization: One Model to Rule Them All☆40Updated 2 years ago
- Optimizing Deep Convolutional Neural Network with Ternarized Weights and High Accuracy☆16Updated 6 years ago
- Revisiting Parameter Sharing for Automatic Neural Channel Number Search, NeurIPS 2020☆21Updated 4 years ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated 2 years ago
- The collection of training tricks of binarized neural networks.☆72Updated 4 years ago
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆14Updated 6 years ago
- BitSplit Post-trining Quantization☆50Updated 3 years ago
- Codes for accepted paper "Cooperative Pruning in Cross-Domain Deep Neural Network Compression" in IJCAI 2019.☆12Updated 5 years ago
- An 8bit automated quantization conversion tool for the pytorch (Post-training quantization based on KL divergence)☆33Updated 5 years ago
- [NeurIPS 2019] E2-Train: Training State-of-the-art CNNs with Over 80% Less Energy☆21Updated 5 years ago
- The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…☆48Updated 4 years ago
- Position-based Scaled Gradient for Model Quantization and Pruning Code (NeurIPS 2020)☆26Updated 4 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Updated 5 years ago
- Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…☆61Updated 3 months ago
- Open Source Neural Machine Translation in PyTorch☆17Updated 6 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆49Updated 6 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆29Updated last year
- Towards Compact CNNs via Collaborative Compression☆11Updated 3 years ago
- Source code for IJCAI 2022 Long paper: Parameter-Efficient Sparsity for Large Language Models Fine-Tuning.☆15Updated 3 years ago
- Proximal Mean-field for Neural Network Quantization☆22Updated 5 years ago
- 3rd place solution for NeurIPS 2019 MicroNet challenge☆35Updated 5 years ago
- Implementation of Neuron-level Structured Pruning using Polarization Regularizer☆82Updated 2 years ago
- Example for applying Gaussian and Laplace clipping on activations of CNN.☆34Updated 6 years ago
- This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.☆88Updated 2 years ago
- Breaking the Curse of Space Explosion: Towards Efficient NAS with Curriculum Search☆16Updated last year