Helsinki-NLP / subalign
☆15Updated last year
Alternatives and similar repositories for subalign:
Users that are interested in subalign are comparing it to the libraries listed below
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated last week
- Multilingual sentence alignment using sentence embeddings☆107Updated 3 months ago
- OpusFilter - Parallel corpus processing toolkit☆104Updated 2 weeks ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆35Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆154Updated 7 months ago
- NTREX -- News Test References for MT Evaluation☆80Updated 8 months ago
- Bilingual term extractor☆53Updated last year
- Efficient Low-Memory Aligner☆141Updated last month
- Bilingual sentence similarity classifier using Tensorflow☆20Updated 5 years ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- Bicleaner fork that uses neural networks☆39Updated 6 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆49Updated last month
- ☆45Updated 6 months ago
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- Efficient teacher-student models and scripts to make them☆49Updated last year
- Transform TMX to text☆28Updated 2 years ago
- A tiny BERT for low-resource monolingual models☆31Updated 4 months ago
- Improved Sentence Alignment in Linear Time and Space☆165Updated last year
- ☆42Updated 6 years ago
- ☆25Updated last year
- Sentence aligner☆108Updated 3 years ago
- ☆71Updated last week
- Morfessor EM+Prune☆10Updated 4 years ago
- Tools for extracting parallel corpora from article titles across languages in Wikipedia☆72Updated 9 years ago
- ☆12Updated 9 years ago
- Translation demonstrator☆30Updated 4 years ago
- Transformer based translation quality estimation☆109Updated last year
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆24Updated last year
- MAGPIE: A sense-annotated corpus of potentially idiomatic expressions☆26Updated 4 years ago
- Python Finite-State Toolkit☆49Updated 3 weeks ago