fe1ixxu / Intra-DistillationLinks
This is the repository for our EMNLP 2022 paper "The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains".
☆10Updated 2 years ago
Alternatives and similar repositories for Intra-Distillation
Users that are interested in Intra-Distillation are comparing it to the libraries listed below
Sorting:
- Code and Data release for "Improving Multilingual Translation by Representation and Gradient Regularization" (Yang et al. EMNLP 2021), an…☆13Updated 10 months ago
- ☆13Updated 4 years ago
- Instruction to data diversification☆25Updated 4 years ago
- ☆20Updated 4 years ago
- Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning (ICLR 2021)☆24Updated 4 years ago
- Code for the paper "Balancing Training for Multilingual Neural Machine Translation, ACL 2020"☆23Updated 4 years ago
- Implementation of our paper "Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation" in EMNLP-2020.☆23Updated 3 years ago
- [NeurIPS 2021] Duplex Sequence-to-Sequence Learning for Reversible Machine Translation☆14Updated 3 years ago
- ☆44Updated 4 years ago
- Introduction and scripts for ACL-2020 paper "On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation"☆21Updated 5 years ago
- Code for NeurIPS 2022 Spotlight paper " Non-Monotonic Latent Alignments for CTC-Based Non-Autoregressive Machine Translation"☆20Updated 2 years ago
- Small utility to monitor fairseq training in tensorboard☆21Updated 6 years ago
- An official implementation of "BPE-Dropout: Simple and Effective Subword Regularization" algorithm.☆52Updated 4 years ago
- Implementation of our paper "Self-training Sampling with Monolingual Data Uncertainty for Neural Machine Translation" to appear in ACL-20…☆31Updated 3 years ago
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)☆30Updated 3 years ago
- Code for Findings of ACL 2023 paper "Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency …☆10Updated last year
- LLM4MT☆9Updated last year
- ☆33Updated 3 years ago
- Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"☆18Updated 3 years ago
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆58Updated 4 years ago
- Code for "Simulated Multiple Reference Training Improves Low-Resource Machine Translation"☆15Updated 4 years ago
- Tools for formatting WMT hypothesis and test sets in XML☆27Updated 2 months ago
- A repository for experiments in quality-aware decoding☆16Updated 3 years ago
- Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"☆13Updated 4 years ago
- Source code for <Sequence-Level Training for Non-Autoregressive Neural Machine Translation>.☆24Updated 3 years ago
- ☆11Updated 3 years ago
- ☆59Updated 2 years ago
- ☆24Updated 2 years ago
- Source code for "Importance-based Neuron Allocation for Multilingual Neural Machine Translation"☆12Updated 3 years ago
- Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…☆22Updated 2 years ago