Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination" accepted in ICML 2020.
☆63Sep 17, 2025Updated last year
Alternatives and similar repositories for PoWER-BERT
Users that are interested in PoWER-BERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 6 years ago
- Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"☆49May 25, 2022Updated 4 years ago
- ☆49Jun 8, 2020Updated 6 years ago
- python project template for personal projects! 🙋♀️☆11Nov 28, 2020Updated 5 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Mar 25, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code for EMNLP 2020 paper CoDIR☆41Oct 4, 2022Updated 4 years ago
- ☆221Jun 8, 2020Updated 6 years ago
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆66Jun 19, 2021Updated 5 years ago
- ☆12Sep 2, 2021Updated 5 years ago
- 매주 목요일, 20:00 모임☆16Jul 24, 2020Updated 6 years ago
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆176Jun 6, 2021Updated 5 years ago
- ☆92Sep 29, 2021Updated 5 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆175Apr 1, 2020Updated 6 years ago
- NLQuAD: A Non-Factoid Long Question Answering Data Set. To be published at EACL2021☆13May 18, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A utility for storing and reading files for Korean LM training 💾☆35Jul 18, 2026Updated 3 months ago
- 세종 구문 분석 말뭉치의 의존 구문 구조로의 변환 도구☆10Sep 7, 2018Updated 8 years ago
- exBERT on Transformers🤗☆10Jun 14, 2021Updated 5 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆22Jan 25, 2023Updated 3 years ago
- Codes for accepted paper "Cooperative Pruning in Cross-Domain Deep Neural Network Compression" in IJCAI 2019.☆12Aug 15, 2019Updated 7 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE) Pytorch Model☆21Sep 2, 2020Updated 6 years ago
- reference pytorch code for named entity tagging☆87Oct 18, 2024Updated 2 years ago
- LM Pretraining with PyTorch/TPU☆137Oct 24, 2019Updated 7 years ago
- ☆15Dec 10, 2021Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- reference pytorch code for intent classification☆44Oct 18, 2024Updated 2 years ago
- Transfer Learning in Dialogue Benchmarking Toolkit☆14Mar 31, 2023Updated 3 years ago
- Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020☆16Mar 21, 2025Updated last year
- Tokenizer 비교 실험☆11Jan 3, 2022Updated 4 years ago
- Scale your ML workers asynchronously across processes and machines☆13Apr 1, 2025Updated last year
- Training T5 to perform numerical reasoning.☆23Jun 4, 2021Updated 5 years ago
- FaVIQ: Fact Verification from Information-seeking Questions☆43Nov 23, 2022Updated 3 years ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆48Aug 2, 2021Updated 5 years ago
- Variational Methods for Pretraining in Resource-limited Environments☆174Jul 29, 2020Updated 6 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 4 years ago
- Codes for Accepted Paper : "MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization" in NeurIPS 2019☆54May 8, 2020Updated 6 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆127Apr 5, 2021Updated 5 years ago
- [NAACL 2021] Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering☆36Apr 20, 2021Updated 5 years ago
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"☆25Jun 2, 2021Updated 5 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆358Feb 22, 2022Updated 4 years ago
- 2019 AI Robotics Korea 1st NLP Study session [DONE]☆10Oct 10, 2019Updated 7 years ago