Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination" accepted in ICML 2020.
☆62Sep 17, 2025Updated 5 months ago
Alternatives and similar repositories for PoWER-BERT
Users that are interested in PoWER-BERT are comparing it to the libraries listed below
Sorting:
- Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"☆48May 25, 2022Updated 3 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- ☆48Jun 8, 2020Updated 5 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆162Mar 25, 2022Updated 3 years ago
- python project template for personal projects! 🙋♀️☆11Nov 28, 2020Updated 5 years ago
- Code for EMNLP 2020 paper CoDIR☆41Oct 4, 2022Updated 3 years ago
- 매주 목요일, 20:00 모임☆16Jul 24, 2020Updated 5 years ago
- Progressively Pretrained Dense Corpus Index for Open-Domain QA and Information Retrieval☆43Jun 12, 2023Updated 2 years ago
- reference pytorch code for named entity tagging☆87Oct 18, 2024Updated last year
- Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020☆16Mar 21, 2025Updated 11 months ago
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆175Jun 6, 2021Updated 4 years ago
- LM Pretraining with PyTorch/TPU☆137Oct 24, 2019Updated 6 years ago
- Code for ACL2022 publication Transkimmer: Transformer Learns to Layer-wise Skim☆22Aug 21, 2022Updated 3 years ago
- 문장단위로 분절된 나무위키 데이터셋. Releases에서 다운로드 받거나, tfds-korean을 통해 다운로드 받으세요.☆19Jun 16, 2021Updated 4 years ago
- Test code of Inverse cloze task for information retrieval☆33Jan 10, 2021Updated 5 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆175Apr 1, 2020Updated 5 years ago
- ☆221Jun 8, 2020Updated 5 years ago
- A utility for storing and reading files for Korean LM training 💾☆35Oct 15, 2025Updated 4 months ago
- NER task for Naver NLP Challenge 2018 (3rd Place)☆18Mar 24, 2023Updated 2 years ago
- FaVIQ: Fact Verification from Information-seeking Questions☆43Nov 23, 2022Updated 3 years ago
- ☆92Sep 29, 2021Updated 4 years ago
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"☆26Jun 2, 2021Updated 4 years ago
- ☆22Oct 26, 2020Updated 5 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆22Jan 25, 2023Updated 3 years ago
- Training T5 to perform numerical reasoning.☆23Jun 4, 2021Updated 4 years ago
- ☆13Sep 2, 2021Updated 4 years ago
- ☆11Aug 12, 2020Updated 5 years ago
- reference pytorch code for intent classification☆44Oct 18, 2024Updated last year
- Variational Methods for Pretraining in Resource-limited Environments☆174Jul 29, 2020Updated 5 years ago
- OOD Generalization and Detection (ACL 2020)☆59Apr 15, 2020Updated 5 years ago
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆66Jun 19, 2021Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆147Jul 26, 2021Updated 4 years ago
- ☆10Aug 28, 2020Updated 5 years ago
- Scale your ML workers asynchronously across processes and machines☆13Apr 1, 2025Updated 11 months ago
- A large scale dataset for Video Captioning in Italian☆13May 16, 2023Updated 2 years ago
- Tokenizer 비교 실험☆11Jan 3, 2022Updated 4 years ago
- Python library for backtranslation (with Google Translate)☆12Jan 11, 2020Updated 6 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 4 years ago
- Simple Questions Generate Named Entity Recognition Datasets (EMNLP 2022)☆76Apr 10, 2023Updated 2 years ago