lyeoni / pretraining-for-language-understanding
Pre-training of Language Models for Language Understanding
☆83Updated 5 years ago
Alternatives and similar repositories for pretraining-for-language-understanding:
Users that are interested in pretraining-for-language-understanding are comparing it to the libraries listed below
- Pytorch and Torchtext implementation of Sequence to sequence☆59Updated 7 years ago
- MT Tutorial for the JSALT 2019 Summer School☆48Updated 5 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- A tutorial on how to implement models for natural language inference using PyTorch and TorchText. [IN PROGRESS]☆25Updated 4 years ago
- Language Model Fine-tuning for Moby Dick☆42Updated 5 years ago
- Backtranslations of IMDB movie reviews for Data Augmentation Purposes☆11Updated 5 years ago
- PyTorch DataLoader for seq2seq☆84Updated 5 years ago
- Sequence to Sequence Models in PyTorch☆44Updated 6 months ago
- Code for EMNLP 2019 paper "Attention is not not Explanation"☆57Updated 3 years ago
- This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …☆55Updated 4 years ago
- Code examples for CMU CS11-731, Machine Translation and Sequence-to-sequence Models☆35Updated 5 years ago
- ☆14Updated 5 years ago
- ☆33Updated 5 years ago
- The bAbI question-answering dataset ported into T2T.☆32Updated 6 years ago
- Checking the interpretability of attention on text classification models☆47Updated 5 years ago
- Companion site for "Analysis Methods in Neural Language Processing: A Survey"☆66Updated 4 years ago
- Adaptive Softmax implementation for PyTorch☆80Updated 5 years ago
- A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and T…☆210Updated 3 years ago
- Encoding position with the word embeddings.☆82Updated 6 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- Code for bidirectional sequence generation (BiSon) for generating from BERT pre-trained models.☆51Updated 4 years ago
- [ACL 2018] Conditional Generators of Words Definitions☆33Updated 6 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Updated 3 years ago
- Training Transformer-XL on 128 GPUs☆140Updated 4 years ago
- Text classification models. Used a submodule for other projects.☆68Updated 5 years ago
- Tools for training pytorch language models☆27Updated 4 years ago
- ☆47Updated 5 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 6 years ago
- Survey on machine learning.☆14Updated 4 years ago