Code for the paper "Are Sixteen Heads Really Better than One?"
☆175Apr 1, 2020Updated 6 years ago
Alternatives and similar repositories for are-16-heads-really-better-than-1
Users that are interested in are-16-heads-really-better-than-1 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…☆325Aug 2, 2021Updated 5 years ago
- Code for EMNLP 2020 paper CoDIR☆41Oct 4, 2022Updated 4 years ago
- Transformer training code for sequential tasks☆610Sep 14, 2021Updated 5 years ago
- ☆475Apr 4, 2021Updated 5 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Jun 12, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆12Nov 25, 2018Updated 7 years ago
- Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…☆63Sep 17, 2025Updated last year
- Tool for Evaluating Adversarial Perturbations on Text☆61Feb 27, 2022Updated 4 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- ☆28Nov 28, 2021Updated 4 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆202Sep 20, 2019Updated 7 years ago
- [EMNLP'19] Summary for Transformer Understanding☆53Nov 26, 2019Updated 6 years ago
- ☆17May 14, 2020Updated 6 years ago
- [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …☆18Dec 30, 2021Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Resources for the MRQA 2019 Shared Task☆294Aug 5, 2021Updated 5 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,167Jan 22, 2024Updated 2 years ago
- Codes for <Kernelized Bayesian Softmax for Text Generation> in NeurIPS 2019☆16Nov 20, 2019Updated 6 years ago
- Longformer: The Long-Document Transformer☆2,208Feb 8, 2023Updated 3 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆358Feb 22, 2022Updated 4 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,922Feb 14, 2023Updated 3 years ago
- Implementation for paper " Unsupervised Domain Adaptation on Reading Comprehension "☆30May 21, 2020Updated 6 years ago
- Code for using and evaluating SpanBERT.☆907Jul 25, 2023Updated 3 years ago
- ☆221Jun 8, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Mar 25, 2022Updated 4 years ago
- Implementation of a Quantized Transformer Model☆20Mar 20, 2019Updated 7 years ago
- A tool for holistic analysis of language generations systems☆471Sep 22, 2025Updated last year
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆127Apr 5, 2021Updated 5 years ago
- Supporting example for "A Rust SentencePiece implementation"☆20Jun 7, 2020Updated 6 years ago
- ☆13Apr 16, 2021Updated 5 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆16Jan 5, 2021Updated 5 years ago
- Code for the paper "Weight Poisoning Attacks on Pre-trained Models" (ACL 2020)☆142Sep 22, 2025Updated last year
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆212Oct 20, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆100Jul 7, 2020Updated 6 years ago
- Latent Alignment and Variational Attention☆327Nov 5, 2018Updated 7 years ago
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆605Feb 7, 2024Updated 2 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,133Apr 20, 2022Updated 4 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Jun 12, 2023Updated 3 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,366Mar 23, 2024Updated 2 years ago
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)☆200Jul 6, 2023Updated 3 years ago