graykode / ALBERT-Pytorch
Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
☆226Updated 3 years ago
Alternatives and similar repositories for ALBERT-Pytorch:
Users that are interested in ALBERT-Pytorch are comparing it to the libraries listed below
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 3 years ago
- ALBERT model Pretraining and Fine Tuning using TF2.0☆201Updated last year
- Statistics and Accepted paper list with arXiv link of EMNLP-IJCNLP 2019☆233Updated 4 years ago
- Source code for transferable dialogue state generator (TRADE, Wu et al., 2019). https://arxiv.org/abs/1905.08743☆391Updated 2 years ago
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆326Updated last year
- Simple XLNet implementation with Pytorch Wrapper☆583Updated 5 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- Resources for the MRQA 2019 Shared Task☆292Updated 3 years ago
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆227Updated 4 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆184Updated last year
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆361Updated 2 years ago
- ☆213Updated 4 years ago
- ☆319Updated 2 years ago
- Contextual augmentation, a text data augmentation using a bidirectional language model.☆192Updated 5 years ago
- Code associated with the Don't Stop Pretraining ACL 2020 paper☆531Updated 3 years ago
- ☆251Updated 2 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆310Updated last year
- Evaluating Cross-lingual Sentence Representations☆449Updated 3 years ago
- ☆96Updated 4 years ago
- Semantics-aware BERT for Language Understanding (AAAI 2020)☆287Updated 2 years ago
- Easy to use NLP library built on PyTorch and TorchText☆254Updated 5 years ago
- Codes for "TENER: Adapting Transformer Encoder for Named Entity Recognition"☆373Updated 4 years ago
- Pytorch Implementation of Google BERT☆593Updated 4 years ago
- Statistics and accepted paper list of NLP conferences with arXiv link☆430Updated 3 years ago
- Repository for the paper "Optimal Subarchitecture Extraction for BERT"☆471Updated 2 years ago
- MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf☆287Updated 3 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- Code for using and evaluating SpanBERT.☆895Updated last year
- Re-implementation of BiDAF(Bidirectional Attention Flow for Machine Comprehension, Minjoon Seo et al., ICLR 2017) on PyTorch.☆244Updated 6 months ago
- IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models☆178Updated 4 years ago