Helsinki-NLP / subalignLinks
☆16Updated 2 years ago
Alternatives and similar repositories for subalign
Users that are interested in subalign are comparing it to the libraries listed below
Sorting:
- Multilingual sentence alignment using sentence embeddings☆139Updated last year
- Improved Sentence Alignment in Linear Time and Space☆187Updated 2 years ago
- ☆34Updated 2 years ago
- Sentence aligner☆123Updated 4 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Updated last year
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆31Updated 2 years ago
- OpusFilter - Parallel corpus processing toolkit☆115Updated last week
- ☆81Updated 2 weeks ago
- Bilingual term extractor☆59Updated 2 months ago
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆54Updated 2 years ago
- ☆42Updated 7 years ago
- Efficient Low-Memory Aligner☆146Updated last year
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 4 months ago
- Machine Translation (MT) Preparation Scripts☆34Updated 8 months ago
- ☆50Updated last year
- Transformer based translation quality estimation☆114Updated 2 years ago
- Punctuation Restoration using Transformer Models for High-and Low-Resource Languages☆227Updated last year
- Bilingual sengence aligner☆28Updated 2 months ago
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆76Updated 2 years ago
- NTREX -- News Test References for MT Evaluation☆87Updated last year
- Code for extracting parallel corpora from pmindia☆17Updated 6 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆256Updated 3 years ago
- Improving Low-Resource Neural Machine Translation of Related Languages by Transfer Learning☆19Updated 3 years ago
- Bicleaner fork that uses neural networks☆40Updated this week
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated 2 years ago
- Complimentary code for our paper Automatic punctuation restoration with BERT models☆50Updated 2 years ago
- Punctuation restoration and spell correction experiments.☆252Updated 4 years ago
- ☆12Updated 10 years ago
- A neural word aligner based on multilingual BERT☆368Updated 3 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆386Updated 2 years ago