Source code for "Efficient Training of BERT by Progressively Stacking"
☆112Jul 3, 2019Updated 7 years ago
Alternatives and similar repositories for StackingBERT
Users that are interested in StackingBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"☆147Jun 10, 2019Updated 7 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆252Nov 8, 2021Updated 4 years ago
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Feb 26, 2025Updated last year
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Dec 9, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This is the repo for the paper "Revealing the Importance of Semantic Retrieval for Machine Reading at Scale".☆60Nov 25, 2019Updated 6 years ago
- Repository for ACL 2019 paper☆74Jun 30, 2019Updated 7 years ago
- Code for EMNLP2021 paper "Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training"☆20Nov 12, 2021Updated 4 years ago
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆212Oct 20, 2021Updated 4 years ago
- Transformer training code for sequential tasks☆610Sep 14, 2021Updated 4 years ago
- Tensorflow Source code for "Recurrently Controlled Recurrent Networks" (NIPS 2018)☆23Oct 25, 2018Updated 7 years ago
- BERT Baseline for the Natural Questions☆11Jan 24, 2019Updated 7 years ago
- A pytorch implementation of QAnet☆26Dec 11, 2018Updated 7 years ago
- NLP library designed for reproducible experimentation management☆294Jul 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,419Jan 10, 2024Updated 2 years ago
- Neural Text Generation with Unlikelihood Training☆311Aug 31, 2021Updated 4 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,923Feb 14, 2023Updated 3 years ago
- The official implementation of paper U-Net: Machine Reading Comprehension with Unanswerable Questions.☆58Nov 14, 2018Updated 7 years ago
- Lightweight non-locking thread pool for multi-threading work jobs☆13May 23, 2016Updated 10 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,259Mar 7, 2024Updated 2 years ago
- Do Neural Language Representations Learn Physical Commonsense?☆22Dec 28, 2021Updated 4 years ago
- Code for SegTree Transformer (ICLR-RLGM 2019).☆27Nov 12, 2019Updated 6 years ago
- "Cross-lingual Distillation for Text Classification" 55th annual meeting of the Association for Computational Linguistics (ACL 2017)☆18Feb 18, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Single Headed Attention RNN - "Stop thinking with your head"☆1,180Nov 27, 2021Updated 4 years ago
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Feb 6, 2023Updated 3 years ago
- Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"☆580Aug 28, 2019Updated 6 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,116Nov 28, 2022Updated 3 years ago
- ☆87Mar 11, 2020Updated 6 years ago
- Website for TextVQA dataset.☆30Apr 30, 2023Updated 3 years ago
- Resources for the MRQA 2019 Shared Task☆294Aug 5, 2021Updated 4 years ago
- This repo describe how to generate the ARC-Challenge submission for BERT Baseline☆25Nov 23, 2022Updated 3 years ago
- Repository for NLI models (EMNLP 2018)☆61Nov 14, 2018Updated 7 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Jul 3, 2019Updated 7 years ago
- Language Model Pruning for Sequence Labeling☆147Feb 29, 2020Updated 6 years ago
- LAnguage Model Analysis☆1,391Jul 7, 2024Updated 2 years ago
- Multitask Learning for Machine Reading Comprehension, NAACL 2019☆102Sep 7, 2020Updated 5 years ago
- ☆19Oct 20, 2019Updated 6 years ago
- ☆99Jul 7, 2020Updated 6 years ago
- [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845☆120Jun 20, 2021Updated 5 years ago