helmy-elrais / RoBERT_Recurrence_over_BERT

pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch implementation of other Hierarchical Methods (Mean Pooling and Max Pooling) and Truncation Methods (Head Only and Tail Only) presented in this paper https://arxiv.org/abs/1905.05583
79Updated 2 years ago

Related projects

Alternatives and complementary repositories for RoBERT_Recurrence_over_BERT