OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
☆58Feb 3, 2026Updated 8 months ago
Alternatives and similar repositories for OpusCleaner
Users that are interested in OpusCleaner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Curriculum training☆25Jun 25, 2025Updated last year
- Efficient teacher-student models and scripts to make them☆58Dec 16, 2023Updated 2 years ago
- Targetted language identifier, based on FastText and Hunspell.☆38Sep 4, 2025Updated last year
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Feb 6, 2024Updated 2 years ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…☆38Aug 29, 2025Updated last year
- Bitextor generates translation memories from multilingual websites☆301Nov 11, 2024Updated last year
- ☆83Updated this week
- [WWW 2026] 🕸 GlotWeb: Web Indexing for Minority Languages☆17Apr 14, 2026Updated 6 months ago
- Translation quality evaluation for Firefox Translations models☆14Oct 23, 2023Updated 3 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆76Apr 1, 2025Updated last year
- NTREX -- News Test References for MT Evaluation☆88Jun 5, 2024Updated 2 years ago
- Fast Neural Machine Translation in C++ - development repository☆24May 12, 2024Updated 2 years ago
- Do Multilingual Language Models Think Better in English?☆42Aug 3, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆140Apr 23, 2026Updated 6 months ago
- Machine Translation (MT) Web Interface for OpenNMT and FairSeq models using CTranslate and Streamlit☆15Dec 24, 2021Updated 4 years ago
- c++ mosestokenizer☆18Mar 13, 2024Updated 2 years ago
- Production-ready batch inference for Cohere’s Arabic/English ASR model, with optimized Silero VAD, multi-file GPU batching, subtitles, an…☆20Jul 15, 2026Updated 3 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆159Jun 18, 2024Updated 2 years ago
- Appraise code used as part of WMT21 human evaluation campaign☆30Aug 6, 2026Updated 2 months ago
- [ACL 2023] Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages☆108Apr 14, 2026Updated 6 months ago
- Adaptive Machine Translation with Large Language Models☆31Jan 4, 2025Updated last year
- [EMNLP 2020] Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆397Nov 7, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Jun 23, 2022Updated 4 years ago
- Transform TMX to text☆27Nov 23, 2022Updated 3 years ago
- Morfessor EM+Prune☆10Jul 22, 2020Updated 6 years ago
- KnowMAN: Weakly Supervised Multinomial Adversarial Networks☆12Nov 9, 2021Updated 4 years ago
- Pipeline and eval for MultiBLiMP☆17Jul 9, 2026Updated 3 months ago
- Scripts for building a geo-located web corpus using Common Crawl data☆11Jan 18, 2026Updated 9 months ago
- ☆21Feb 13, 2023Updated 3 years ago
- Tool for manual evaluation of parallel sentences.☆15Oct 23, 2026Updated last week
- ☆10Oct 2, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Simple word to frequency mappings for the german language based on text corpora and using CISTEM stemmer.☆14Apr 3, 2021Updated 5 years ago
- Sampling-Based Minimum Bayes-Risk Decoding for Neural Machine Translation☆16Oct 14, 2022Updated 4 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- Collection of swadesh lists in CSV table format with possible connections to Indo European☆13Apr 9, 2026Updated 6 months ago
- ☆29Jul 30, 2024Updated 2 years ago
- Efficient Low-Memory Aligner☆148Jan 15, 2025Updated last year
- ☆12Apr 24, 2025Updated last year