tacchinotacchi / distil-bilstmLinks
Scripts to train a bidirectional LSTM with knowledge distillation from BERT
☆158Updated 5 years ago
Alternatives and similar repositories for distil-bilstm
Users that are interested in distil-bilstm are comparing it to the libraries listed below
Sorting:
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆107Updated 2 years ago
- XLNet: fine tuning on RTX 2080 GPU - 8 GB☆154Updated 5 years ago
- XLNet for generating language.☆165Updated 4 years ago
- Implementation of ULMFit algorithm for text classification via transfer learning☆94Updated 6 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- Python package for understanding the difficulty of text classification datasets. (in CoNNL 2018)☆63Updated 4 years ago
- ☆58Updated 5 years ago
- LM, ULMFit et al.☆46Updated 5 years ago
- We summarize the summarization papers presented at major conferences (starting with ACL 2019)☆85Updated 5 years ago
- Training Transformer-XL on 128 GPUs☆140Updated 4 years ago
- Sequence to Sequence Models in PyTorch☆44Updated 9 months ago
- PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset☆123Updated 5 years ago
- Code for the paper "Efficient Adaption of Pretrained Transformers for Abstractive Summarization"☆71Updated 6 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- The Annotated Encoder Decoder with Attention☆166Updated 4 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆226Updated 4 years ago
- Variational Methods for Pretraining in Resource-limited Environments☆174Updated 4 years ago
- Fine Tuning Language Models for Multilabel Prediction☆61Updated 2 years ago
- Comparing Text Classification results using BERT embedding and ULMFIT embedding☆65Updated 6 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆250Updated 7 years ago
- Authors' implementation of EMNLP-IJCNLP 2019 paper "Answering Complex Open-domain Questions Through Iterative Query Generation"☆195Updated 5 years ago
- PyTorch DataLoader for seq2seq☆85Updated 6 years ago
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆209Updated 3 years ago
- Pytorch and Torchtext implementation of Sequence to sequence☆59Updated 7 years ago
- Gendered Ambiguous Pronouns Shared Task☆31Updated 2 years ago
- ☆47Updated 6 years ago
- ☆218Updated 4 years ago
- Source code for the NAACL 2019 paper "SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sen…☆124Updated 2 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 6 years ago
- Text Generation Using A Variational Autoencoder☆109Updated 7 years ago