tacchinotacchi / distil-bilstm
Scripts to train a bidirectional LSTM with knowledge distillation from BERT
☆158Updated 5 years ago
Alternatives and similar repositories for distil-bilstm:
Users that are interested in distil-bilstm are comparing it to the libraries listed below
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- XLNet: fine tuning on RTX 2080 GPU - 8 GB☆154Updated 5 years ago
- LM, ULMFit et al.☆46Updated 5 years ago
- ☆58Updated 5 years ago
- Implementation of ULMFit algorithm for text classification via transfer learning☆94Updated 6 years ago
- XLNet for generating language.☆165Updated 4 years ago
- Re-implementation of ELMo on Keras☆134Updated last year
- Variational Methods for Pretraining in Resource-limited Environments☆174Updated 4 years ago
- Authors' implementation of EMNLP-IJCNLP 2019 paper "Answering Complex Open-domain Questions Through Iterative Query Generation"☆195Updated 5 years ago
- Bidirectional Attention Flow for Machine Comprehension implemented in Keras 2☆64Updated 2 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- The Annotated Encoder Decoder with Attention☆166Updated 4 years ago
- A short tutorial on Elmo training (Pre trained, Training on new data, Incremental training)☆154Updated 4 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- Implementation of a linear-chain CRF in PyTorch☆96Updated 4 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 5 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- BertQA - Attention on Steroids☆115Updated 2 years ago
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆210Updated 3 years ago
- Comparing Text Classification results using BERT embedding and ULMFIT embedding☆65Updated 6 years ago
- Learning Framework for Neural Abstractive Text Summarization☆104Updated 5 years ago
- Python package for understanding the difficulty of text classification datasets. (in CoNNL 2018)☆63Updated 4 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆362Updated 3 years ago
- Encoding position with the word embeddings.☆82Updated 6 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆250Updated 6 years ago
- Pre-training of Language Models for Language Understanding☆83Updated 5 years ago
- DeepThought's solution☆80Updated last year
- ☆47Updated 5 years ago
- architectures and pre-trained models for long document classification.☆154Updated 4 years ago
- Easy to use NLP library built on PyTorch and TorchText☆255Updated 5 years ago