Helsinki-NLP / subalignLinks
☆16Updated last year
Alternatives and similar repositories for subalign
Users that are interested in subalign are comparing it to the libraries listed below
Sorting:
- Multilingual sentence alignment using sentence embeddings☆122Updated 9 months ago
- ☆30Updated last year
- Improved Sentence Alignment in Linear Time and Space☆180Updated 2 years ago
- Sentence aligner☆116Updated 4 years ago
- OpusFilter - Parallel corpus processing toolkit☆109Updated 3 weeks ago
- Bilingual term extractor☆58Updated last year
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆158Updated last year
- ☆49Updated last year
- Code for extracting parallel corpora from pmindia☆16Updated 5 years ago
- ☆42Updated 7 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆31Updated 6 months ago
- Bicleaner fork that uses neural networks☆40Updated 2 months ago
- NTREX -- News Test References for MT Evaluation☆85Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆51Updated last month
- ☆74Updated last week
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆47Updated 2 years ago
- Efficient Low-Memory Aligner☆146Updated 7 months ago
- Caucasus languages focused multilingual and monolingual corpuses for Natural Language Processing(NLP)☆35Updated 9 months ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆14Updated last year
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆76Updated last year
- Improving Low-Resource Neural Machine Translation of Related Languages by Transfer Learning☆18Updated 2 years ago
- Transformer based translation quality estimation☆113Updated 2 years ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆252Updated 2 years ago
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆26Updated 2 years ago
- Machine-Translation-based sentence alignment tool for parallel text☆312Updated 4 years ago
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆101Updated last year
- Efficient Markov Chain word alignment☆53Updated 4 years ago
- Morfessor EM+Prune☆10Updated 5 years ago
- ☆11Updated 3 years ago