helmy-elrais / RoBERT_Recurrence_over_BERTLinks
pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch implementation of other Hierarchical Methods (Mean Pooling and Max Pooling) and Truncation Methods (Head Only and Tail Only) presented in this paper https://arxiv.org/abs/1905.05583
☆82Updated 2 years ago
Alternatives and similar repositories for RoBERT_Recurrence_over_BERT
Users that are interested in RoBERT_Recurrence_over_BERT are comparing it to the libraries listed below
Sorting:
- A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)☆132Updated last year
- A repo to explore different NLP tasks which can be solved using T5☆172Updated 4 years ago
- ☆59Updated 2 years ago
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…☆203Updated 2 years ago
- ☆87Updated 3 years ago
- https://arxiv.org/pdf/1909.04054☆79Updated 2 years ago
- Collection of NLP model explanations and accompanying analysis tools☆144Updated 2 years ago
- architectures and pre-trained models for long document classification.☆155Updated 4 years ago
- Research framework for low resource text classification that allows the user to experiment with classification models and active learning…☆102Updated 3 years ago
- ☆42Updated 3 years ago
- Implementation of Self-adjusting Dice Loss from "Dice Loss for Data-imbalanced NLP Tasks" paper☆108Updated 4 years ago
- ☆346Updated 3 years ago
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper☆133Updated 2 years ago
- Named Entity Recognition with Pretrained XLM-RoBERTa☆90Updated 3 years ago
- Codebase for the Medium Article on Fine-tuning GPT2 for Text Generation☆70Updated 5 years ago
- Applying BERT to named entity recognition in English and Russian.☆162Updated 2 years ago
- A Framework for Textual Entailment based Zero Shot text classification☆152Updated last year
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approa…☆97Updated 3 years ago
- Efficient Attention for Long Sequence Processing☆95Updated last year
- Detect toxic spans in toxic texts☆69Updated 2 years ago
- State of the art Semantic Sentence Embeddings☆99Updated 3 years ago
- Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"☆202Updated last year
- Large-Scale Multi-Label Text Classification on EU Legislation☆96Updated last year
- Repository that accompanies "An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction" (EMNLP 2019)☆210Updated 4 years ago
- Tutorial for first time BERT users,☆103Updated 2 years ago
- BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision☆290Updated 4 years ago
- Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on the task of sentence entailment using two datasets - MultiNLI …☆27Updated 4 years ago
- A long version of BART model based on Longformer model☆23Updated 2 years ago
- GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge (EMNLP 2019)☆95Updated 2 years ago
- A library to conduct ranking experiments with transformers.☆160Updated 2 years ago