hplt-project / OpusTrainerLinks
Curriculum training
☆22Updated 7 months ago
Alternatives and similar repositories for OpusTrainer
Users that are interested in OpusTrainer are comparing it to the libraries listed below
Sorting:
- NTREX -- News Test References for MT Evaluation☆87Updated last year
- OpusFilter - Parallel corpus processing toolkit☆115Updated last week
- ☆27Updated last year
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆22Updated 2 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆162Updated 4 months ago
- ☆131Updated last week
- ☆34Updated 2 years ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆87Updated last year
- ☆50Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆57Updated 3 months ago
- A accurate multilingual word aligner based on LaBSE☆24Updated 2 years ago
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆36Updated 7 months ago
- A library of translation-based text similarity measures☆25Updated 2 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆125Updated 3 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆107Updated last year
- A library for minimum Bayes risk (MBR) decoding☆51Updated 2 months ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆30Updated this week
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 10 months ago
- Do Multilingual Language Models Think Better in English?☆42Updated 2 years ago
- A repository for experiments in quality-aware decoding☆18Updated 3 years ago
- Bicleaner fork that uses neural networks☆40Updated last week
- GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)☆18Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆102Updated last year
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Updated 3 years ago
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆99Updated 2 years ago
- Efficient Low-Memory Aligner☆146Updated last year
- Experiments for XLM-V Transformers Integeration☆13Updated 2 years ago
- ☆16Updated 3 years ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated 2 years ago