microsoft / Lightweight-Low-Resource-NMTLinks
Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models" to appear in WMT 2022.
☆17Updated last month
Alternatives and similar repositories for Lightweight-Low-Resource-NMT
Users that are interested in Lightweight-Low-Resource-NMT are comparing it to the libraries listed below
Sorting:
- We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This datase…☆41Updated 2 years ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆283Updated 3 weeks ago
- Research code for pixel-based encoders of language (PIXEL)☆344Updated 3 months ago
- ☆72Updated 2 years ago
- ☆84Updated 2 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆178Updated 2 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆158Updated 2 years ago
- ☆22Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- M4 experiment logbook☆57Updated 2 years ago
- An instruction-based benchmark for text improvements.☆143Updated 2 years ago
- ☆220Updated 3 months ago
- Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…☆41Updated 2 years ago
- Big-Interleaved-Dataset☆57Updated 2 years ago
- Code for Zero-Shot Tokenizer Transfer☆140Updated 9 months ago
- Evaluation pipeline for the BabyLM Challenge 2023.☆76Updated 2 years ago
- DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization☆29Updated 2 years ago
- NTREX -- News Test References for MT Evaluation☆86Updated last year
- ☆65Updated 2 years ago
- ☆39Updated last year
- UNISUMM: Unified Few-shot Summarization with Multi-Task Pre-Training and Prefix-Tuning☆61Updated 2 years ago
- ☆115Updated 10 months ago
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆230Updated last year
- Scaling Data-Constrained Language Models☆342Updated 4 months ago
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆209Updated last year
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆187Updated 3 years ago
- ☆101Updated 2 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆188Updated 3 years ago
- This repository contains the code and instructions needed to reproduce the dataset splits for out paper "Speech Translation for Code-Swit…☆29Updated 3 years ago
- Index of URLs to pdf files all over the internet and scripts☆24Updated 2 years ago