MarkusSagen / Master-Thesis-Multilingual-Longformer
Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).
☆33Updated 3 years ago
Alternatives and similar repositories for Master-Thesis-Multilingual-Longformer:
Users that are interested in Master-Thesis-Multilingual-Longformer are comparing it to the libraries listed below
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 2 years ago
- Collection of NLP model explanations and accompanying analysis tools☆145Updated last year
- ☆68Updated 3 years ago
- ☆87Updated 3 years ago
- State of the art Semantic Sentence Embeddings☆99Updated 2 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆94Updated 2 years ago
- ☆92Updated 3 years ago
- QED: A Framework and Dataset for Explanations in Question Answering☆116Updated 3 years ago
- A long version of BART model based on Longformer model☆23Updated last year
- ☆77Updated 11 months ago
- ☆75Updated 3 years ago
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…☆202Updated 2 years ago
- Code for NAACL 2021 full paper "Efficient Attentions for Long Document Summarization"☆67Updated 3 years ago
- ☆41Updated 3 years ago
- LongSumm - Scientific Document Summarization Task☆74Updated 2 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆81Updated 2 years ago
- ☆47Updated 2 years ago
- ☆38Updated 2 years ago
- Pytorch implementation of Highly Parallel Autoregressive Entity Linking with Discriminative Correction☆67Updated 2 years ago
- Coreference resolution with different higher-order inference methods; implemented in PyTorch.☆36Updated last year
- A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)☆132Updated last year
- ☆36Updated last year
- ☆44Updated 2 years ago
- Codebase, data and models for the Keep it Simple paper at ACL2021☆39Updated last year
- [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction☆119Updated 3 years ago
- This is the official code for Extractive Summarization of Long Documents by Combining Global and Local Context☆69Updated 4 years ago
- EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering☆38Updated 3 years ago
- This repo supports various cross-lingual transfer learning & multilingual NLP models.☆92Updated last year
- ☆58Updated 2 years ago
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆75Updated 3 years ago