OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
☆57Feb 3, 2026Updated last month
Alternatives and similar repositories for OpusCleaner
Users that are interested in OpusCleaner are comparing it to the libraries listed below
Sorting:
- Targetted language identifier, based on FastText and Hunspell.☆38Sep 4, 2025Updated 6 months ago
- 🕸 GlotWeb: Web Indexing for Minority Languages (WWW 2026)☆17Updated this week
- Bicleaner fork that uses neural networks☆40Feb 23, 2026Updated last week
- A library for data streaming and augmentation☆21May 5, 2025Updated 9 months ago
- The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…☆36Aug 29, 2025Updated 6 months ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Apr 1, 2025Updated 11 months ago
- A tool that locates, downloads, and extracts machine translation corpora☆162Sep 18, 2025Updated 5 months ago
- Do Multilingual Language Models Think Better in English?☆42Aug 3, 2023Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- Efficient teacher-student models and scripts to make them☆54Dec 16, 2023Updated 2 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Apr 20, 2024Updated last year
- KnowMAN: Weakly Supervised Multinomial Adversarial Networks☆12Nov 9, 2021Updated 4 years ago
- ☆10Sep 13, 2022Updated 3 years ago
- ☆21Feb 13, 2023Updated 3 years ago
- 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Apr 6, 2025Updated 10 months ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆126Oct 13, 2025Updated 4 months ago
- Bitextor generates translation memories from multilingual websites☆301Nov 11, 2024Updated last year
- OpusFilter - Parallel corpus processing toolkit☆115Feb 11, 2026Updated 3 weeks ago
- ☆11Jun 23, 2022Updated 3 years ago
- GlotEval: a unified evaluation toolkit designed to benchmark multilingual Large Language Models (LLMs) in a language-specific way☆18Nov 4, 2025Updated 4 months ago
- A free, fast and accurate routine to compute the position of the Sun☆20Feb 13, 2024Updated 2 years ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆35Feb 5, 2026Updated 3 weeks ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆389Nov 7, 2023Updated 2 years ago
- Fast Neural Machine Translation in C++ - development repository☆22May 12, 2024Updated last year
- 🕸 GlotCC Dataset and Pipline -- NeurIPS 2024☆20Apr 6, 2025Updated 10 months ago
- 🖋 Resource and Tool for Writing System Identification (Unicode 17.0) -- LREC 2024☆21Feb 17, 2026Updated 2 weeks ago
- c++ mosestokenizer☆18Mar 13, 2024Updated last year
- Source code for the ACL-IJCNLP 2021 paper entitled "T-DNA: Taming Pre-trained Language Models with N-gram Representations for Low-Resourc…☆19Jan 12, 2023Updated 3 years ago
- ☆82Jan 30, 2026Updated last month
- NTREX -- News Test References for MT Evaluation☆88Jun 5, 2024Updated last year
- Data Collection System For NLP/Speech Recognition☆25Apr 20, 2021Updated 4 years ago
- ☆44Feb 11, 2026Updated 3 weeks ago
- A repository containing the code for speech translation papers.☆21Mar 11, 2022Updated 3 years ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆28Feb 8, 2023Updated 3 years ago
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"☆26Jun 2, 2021Updated 4 years ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆26Dec 12, 2024Updated last year
- ☆23Nov 15, 2022Updated 3 years ago
- Climate Crisis, is a variable font designed to help visualise the urgency of climate change.☆29Feb 20, 2026Updated last week
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆30Feb 25, 2026Updated last week