helmy-elrais / RoBERT_Recurrence_over_BERT
pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch implementation of other Hierarchical Methods (Mean Pooling and Max Pooling) and Truncation Methods (Head Only and Tail Only) presented in this paper https://arxiv.org/abs/1905.05583
☆79Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for RoBERT_Recurrence_over_BERT
- https://arxiv.org/pdf/1909.04054☆77Updated 2 years ago
- architectures and pre-trained models for long document classification.☆154Updated 3 years ago
- ☆40Updated 3 years ago
- This shows how to fine-tune Bert language model and use PyTorch-transformers for text classififcation☆69Updated 4 years ago
- Using BERT For Classifying Documents with Long Texts, check my latest post: https://armandolivares.tech/☆40Updated 4 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆80Updated 2 years ago
- ☆57Updated last year
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper☆133Updated last year
- ☆85Updated 2 years ago
- A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.☆46Updated last year
- Named Entity Recognition with Pretrained XLM-RoBERTa☆87Updated 3 years ago
- A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)☆129Updated 9 months ago
- Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020).☆76Updated 4 years ago
- Lexical Simplification with Pretrained Encoders☆69Updated 3 years ago
- GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge (EMNLP 2019)☆92Updated 2 years ago
- Collection of NLP model explanations and accompanying analysis tools☆145Updated last year
- A repo to explore different NLP tasks which can be solved using T5☆169Updated 3 years ago
- Detect toxic spans in toxic texts☆66Updated last year
- Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…☆32Updated 3 years ago
- This repository contains the corpora and supplementary data, along with instructions for recreating the experiments, for our paper: "End-…☆91Updated 4 years ago
- Implementation of Self-adjusting Dice Loss from "Dice Loss for Data-imbalanced NLP Tasks" paper☆105Updated 3 years ago
- Tutorial for first time BERT users,☆102Updated last year
- ☆67Updated 3 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆91Updated last year
- Models for automatically transforming toxic text to neutral☆33Updated last year
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approa…☆88Updated 2 years ago
- BERT for Evidence Retrieval and Claim Verification☆34Updated 4 years ago
- BERTserini☆25Updated 2 years ago
- Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in …☆119Updated 4 years ago
- Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on the task of sentence entailment using two datasets - MultiNLI …☆27Updated 3 years ago