MarkusSagen / Master-Thesis-Multilingual-Longformer

Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).
33Updated 3 years ago

Alternatives and similar repositories for Master-Thesis-Multilingual-Longformer:

Users that are interested in Master-Thesis-Multilingual-Longformer are comparing it to the libraries listed below