Source code for "Efficient Training of BERT by Progressively Stacking"
☆112Jul 3, 2019Updated 6 years ago
Alternatives and similar repositories for StackingBERT
Users that are interested in StackingBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"☆147Jun 10, 2019Updated 6 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆252Nov 8, 2021Updated 4 years ago
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Feb 26, 2025Updated last year
- ☆11Nov 13, 2020Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Dec 9, 2021Updated 4 years ago
- This is the repo for the paper "Revealing the Importance of Semantic Retrieval for Machine Reading at Scale".☆60Nov 25, 2019Updated 6 years ago
- Code for EMNLP2021 paper "Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training"☆20Nov 12, 2021Updated 4 years ago
- Repository for ACL 2019 paper☆74Jun 30, 2019Updated 6 years ago
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆210Oct 20, 2021Updated 4 years ago
- Transformer training code for sequential tasks☆609Sep 14, 2021Updated 4 years ago
- Tensorflow Source code for "Recurrently Controlled Recurrent Networks" (NIPS 2018)☆23Oct 25, 2018Updated 7 years ago
- BERT Baseline for the Natural Questions☆11Jan 24, 2019Updated 7 years ago
- A pytorch implementation of QAnet☆28Dec 11, 2018Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- NLP library designed for reproducible experimentation management☆294Jul 25, 2024Updated last year
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,417Jan 10, 2024Updated 2 years ago
- Neural Text Generation with Unlikelihood Training☆310Aug 31, 2021Updated 4 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,927Feb 14, 2023Updated 3 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,257Mar 7, 2024Updated 2 years ago
- The official implementation of paper U-Net: Machine Reading Comprehension with Unanswerable Questions.☆58Nov 14, 2018Updated 7 years ago
- Do Neural Language Representations Learn Physical Commonsense?☆22Dec 28, 2021Updated 4 years ago
- Code for SegTree Transformer (ICLR-RLGM 2019).☆27Nov 12, 2019Updated 6 years ago
- Lightweight non-locking thread pool for multi-threading work jobs☆13May 23, 2016Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- "Cross-lingual Distillation for Text Classification" 55th annual meeting of the Association for Computational Linguistics (ACL 2017)☆18Feb 18, 2018Updated 8 years ago
- Single Headed Attention RNN - "Stop thinking with your head"☆1,181Nov 27, 2021Updated 4 years ago
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Feb 6, 2023Updated 3 years ago
- ☆86Mar 11, 2020Updated 6 years ago
- Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"☆580Aug 28, 2019Updated 6 years ago
- Repository for NLI models (EMNLP 2018)☆61Nov 14, 2018Updated 7 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,122Nov 28, 2022Updated 3 years ago
- Implementation of NAACL'19 Strong and Simple Baselines for Multimodal Utterance Embeddings☆10Jun 4, 2019Updated 6 years ago
- Website for TextVQA dataset.☆28Apr 30, 2023Updated 2 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Resources for the MRQA 2019 Shared Task☆294Aug 5, 2021Updated 4 years ago
- This repo describe how to generate the ARC-Challenge submission for BERT Baseline☆25Nov 23, 2022Updated 3 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Jul 3, 2019Updated 6 years ago
- Language Model Pruning for Sequence Labeling☆147Feb 29, 2020Updated 6 years ago
- LAnguage Model Analysis☆1,389Jul 7, 2024Updated last year
- ☆99Jul 7, 2020Updated 5 years ago
- Multitask Learning for Machine Reading Comprehension, NAACL 2019☆102Sep 7, 2020Updated 5 years ago