VarunGumma / fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
☆22Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for fairseq
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 8 months ago
- NTREX -- News Test References for MT Evaluation☆75Updated 5 months ago
- A library for minimum Bayes risk (MBR) decoding☆31Updated last week
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆19Updated 2 years ago
- Library for pruning experts per language pair in NLLB-200☆27Updated last year
- Bicleaner fork that uses neural networks☆38Updated 3 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆96Updated 7 months ago
- A guide to building language technology in new languages.☆57Updated 2 years ago
- Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …☆71Updated last year
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆75Updated 2 months ago
- Repository containing the open source code of works published at the FBK MT unit.☆42Updated 4 months ago
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆251Updated last month
- Morfessor EM+Prune☆10Updated 4 years ago
- Reduce the size of pretrained Hugging Face models via vocabulary trimming.☆43Updated last year
- LTG-Bert☆29Updated 10 months ago
- Universal Romanizer that can convert any unicode script to roman (latin) script☆154Updated 3 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆48Updated 2 months ago
- The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…☆32Updated 9 months ago
- ☆17Updated 2 years ago
- Curriculum training☆16Updated 2 months ago
- Official implementation of "GPT or BERT: why not both?"☆36Updated last week
- SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP☆14Updated 3 years ago
- ☆20Updated last year
- ☆193Updated this week
- An official implementation of "BPE-Dropout: Simple and Effective Subword Regularization" algorithm.☆48Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkit☆102Updated 3 months ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆23Updated last year
- A tiny BERT for low-resource monolingual models☆29Updated last month
- ☆22Updated last year