mt-upc / transformer-contributions
Measuring the Mixing of Contextual Information in the Transformer
☆25Updated last year
Related projects ⓘ
Alternatives and complementary repositories for transformer-contributions
- Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑☆13Updated 7 months ago
- ☆15Updated 2 years ago
- ☆77Updated 7 months ago
- The geometry of multilingual language model representations (EMNLP 2022).☆15Updated 2 years ago
- ☆17Updated 10 months ago
- EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling☆31Updated 3 years ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆31Updated 2 years ago
- [NAACL 2022] GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers☆21Updated last year
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)☆29Updated 2 years ago
- ☆24Updated 3 years ago
- ☆24Updated 5 months ago
- Code of NAACL 2022 "Efficient Hierarchical Domain Adaptation for Pretrained Language Models" paper.☆32Updated last year
- ☆34Updated 6 months ago
- Benchmark API for Multidomain Language Modeling☆24Updated 2 years ago
- ☆14Updated 3 years ago
- ☆58Updated 2 years ago
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆30Updated last year
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆21Updated 2 weeks ago
- ☆20Updated 2 years ago
- Rationales for Sequential Predictions☆40Updated 2 years ago
- ☆28Updated last year
- Influence Experiments☆35Updated last year
- Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".☆13Updated 3 years ago
- ☆37Updated 3 years ago
- ☆20Updated 3 years ago
- DiffusER: Discrete Diffusion via Edit-based Reconstruction (Reid, Hellendoorn & Neubig, 2022)☆54Updated last year
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆23Updated last month
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆59Updated 4 years ago
- ☆33Updated 3 years ago
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago