helmy-elrais / RoBERT_Recurrence_over_BERTLinks
pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch implementation of other Hierarchical Methods (Mean Pooling and Max Pooling) and Truncation Methods (Head Only and Tail Only) presented in this paper https://arxiv.org/abs/1905.05583
☆82Updated 3 years ago
Alternatives and similar repositories for RoBERT_Recurrence_over_BERT
Users that are interested in RoBERT_Recurrence_over_BERT are comparing it to the libraries listed below
Sorting:
- ☆60Updated 3 years ago
- A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)☆138Updated last year
- ☆88Updated 4 years ago
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…☆206Updated 3 years ago
- A repo to explore different NLP tasks which can be solved using T5☆173Updated 4 years ago
- ☆42Updated 4 years ago
- https://arxiv.org/pdf/1909.04054☆78Updated 3 years ago
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper☆136Updated 2 years ago
- State of the art Semantic Sentence Embeddings☆99Updated 3 years ago
- Research framework for low resource text classification that allows the user to experiment with classification models and active learning…☆101Updated 3 years ago
- Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"☆200Updated 2 years ago
- Implementation of Self-adjusting Dice Loss from "Dice Loss for Data-imbalanced NLP Tasks" paper☆109Updated 5 years ago
- Collection of NLP model explanations and accompanying analysis tools☆144Updated 2 years ago
- A library to conduct ranking experiments with transformers.☆160Updated 2 years ago
- Named Entity Recognition with Pretrained XLM-RoBERTa☆92Updated 4 years ago
- Enhancing the BERT training with Semi-supervised Generative Adversarial Networks☆229Updated 2 years ago
- ☆42Updated 5 years ago
- Lexical Simplification with Pretrained Encoders☆70Updated 4 years ago
- ☆345Updated 4 years ago
- Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data☆100Updated 2 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆78Updated 3 years ago
- A Framework for Textual Entailment based Zero Shot text classification☆153Updated last year
- [EMNLP 2021] Improving and Simplifying Pattern Exploiting Training☆153Updated 3 years ago
- Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…☆35Updated 4 years ago
- BERTserini☆26Updated 3 years ago
- Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020).☆80Updated 5 years ago
- [ACL-IJCNLP 2021] Automated Concatenation of Embeddings for Structured Prediction☆311Updated 3 years ago
- ☆68Updated 7 months ago
- architectures and pre-trained models for long document classification.☆155Updated 4 years ago
- Code and resources for the paper "BERT-QE: Contextualized Query Expansion for Document Re-ranking".☆51Updated 4 years ago