Code for the paper "Are Sixteen Heads Really Better than One?"
☆175Apr 1, 2020Updated 6 years ago
Alternatives and similar repositories for are-16-heads-really-better-than-1
Users that are interested in are-16-heads-really-better-than-1 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…☆326Aug 2, 2021Updated 5 years ago
- Code for EMNLP 2020 paper CoDIR☆41Oct 4, 2022Updated 4 years ago
- Transformer training code for sequential tasks☆611Sep 14, 2021Updated 5 years ago
- ☆475Apr 4, 2021Updated 5 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Jun 12, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12Nov 25, 2018Updated 7 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆202Sep 20, 2019Updated 7 years ago
- Tool for Evaluating Adversarial Perturbations on Text☆61Feb 27, 2022Updated 4 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 6 years ago
- ☆28Nov 28, 2021Updated 4 years ago
- [EMNLP'19] Summary for Transformer Understanding☆53Nov 26, 2019Updated 6 years ago
- PyTorch code for meta seq2seq learning☆44Jan 14, 2020Updated 6 years ago
- [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …☆18Dec 30, 2021Updated 4 years ago
- Resources for the MRQA 2019 Shared Task☆294Aug 5, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code for using and evaluating SpanBERT.☆907Jul 25, 2023Updated 3 years ago
- ☆17May 14, 2020Updated 6 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,167Jan 22, 2024Updated 2 years ago
- Codes for <Kernelized Bayesian Softmax for Text Generation> in NeurIPS 2019☆16Nov 20, 2019Updated 7 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,921Feb 14, 2023Updated 3 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆358Feb 22, 2022Updated 4 years ago
- Longformer: The Long-Document Transformer☆2,207Feb 8, 2023Updated 3 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Mar 25, 2022Updated 4 years ago
- Implementation for paper " Unsupervised Domain Adaptation on Reading Comprehension "☆30May 21, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆220Jun 8, 2020Updated 6 years ago
- Implementation of a Quantized Transformer Model☆20Mar 20, 2019Updated 7 years ago
- A tool for holistic analysis of language generations systems☆472Sep 22, 2025Updated last year
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆127Apr 5, 2021Updated 5 years ago
- Supporting example for "A Rust SentencePiece implementation"☆20Jun 7, 2020Updated 6 years ago
- ☆13Apr 16, 2021Updated 5 years ago
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆606Feb 7, 2024Updated 2 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆16Jan 5, 2021Updated 5 years ago
- ☆17Aug 20, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for the paper "Weight Poisoning Attacks on Pre-trained Models" (ACL 2020)☆142Sep 22, 2025Updated last year
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆212Oct 20, 2021Updated 5 years ago
- ☆100Jul 7, 2020Updated 6 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,132Apr 20, 2022Updated 4 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Jun 12, 2023Updated 3 years ago
- Latent Alignment and Variational Attention☆327Nov 11, 2026Updated last week
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)☆200Jul 6, 2023Updated 3 years ago
Are these results useful?