robeld / ERNIE
Open Source Neural Machine Translation in PyTorch
☆17Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for ERNIE
- Implementation of a Quantized Transformer Model☆17Updated 5 years ago
- Compression of NMT transformer model with tensor methods☆48Updated 5 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆153Updated 2 years ago
- [KDD'22] Learned Token Pruning for Transformers☆93Updated last year
- Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…☆58Updated last year
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆100Updated 4 years ago
- Block Sparse movement pruning☆78Updated 3 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆169Updated 4 years ago
- ☆195Updated 3 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆330Updated 4 months ago
- [ICML'21 Oral] I-BERT: Integer-only BERT Quantization☆229Updated last year
- [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408☆191Updated last year
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- Implementation of NeurIPS 2019 paper "Normalization Helps Training of Quantized LSTM"☆30Updated 3 months ago
- Code associated with the paper **SkipBERT: Efficient Inference with Shallow Layer Skipping**, at ACL 2022☆15Updated 2 years ago
- Source code for IJCAI 2022 Long paper: Parameter-Efficient Sparsity for Large Language Models Fine-Tuning.☆13Updated 2 years ago
- Transformers without Tears: Improving the Normalization of Self-Attention☆130Updated 5 months ago
- This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.☆84Updated last year
- Must-read papers on improving efficiency for pre-trained language models.☆102Updated 2 years ago
- [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…☆138Updated 2 years ago
- ☆17Updated 4 years ago
- Source code for "Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation"☆19Updated 5 years ago
- A library for researching neural networks compression and acceleration methods.☆136Updated 2 months ago
- ☆14Updated last year
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆64Updated 3 years ago
- DisCo Transformer for Non-autoregressive MT☆78Updated 2 years ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆171Updated last year
- ☆42Updated 4 years ago
- Parameter Efficient Transfer Learning with Diff Pruning☆72Updated 3 years ago
- Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"☆44Updated 2 years ago