kbatsuren / MorphyNet
MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)
☆36Updated last year
Related projects: ⓘ
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆23Updated last year
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- OpusFilter - Parallel corpus processing toolkit☆101Updated last month
- Efficient Low-Memory Aligner☆135Updated 2 weeks ago
- Bicleaner fork that uses neural networks☆37Updated last month
- NTREX -- News Test References for MT Evaluation☆73Updated 3 months ago
- A tool that locates, downloads, and extracts machine translation corpora☆145Updated 3 months ago
- ☆42Updated last month
- Curriculum training☆15Updated this week
- A tiny BERT for low-resource monolingual models☆28Updated 4 months ago
- A accurate multilingual word aligner based on LaBSE☆18Updated 10 months ago
- A Language-Independent Unsupervised Morphological Segmentation Framework based on Adaptor Grammars☆15Updated 3 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆148Updated 3 months ago
- cLang-8 is a dataset for grammatical error correction.☆102Updated 2 years ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆40Updated 9 months ago
- ☆19Updated 2 years ago
- Morfessor EM+Prune☆10Updated 4 years ago
- Improved Sentence Alignment in Linear Time and Space☆157Updated last year
- A guide to building language technology in new languages.☆57Updated 2 years ago
- Small-vocabulary sequence-to-sequence generation with optional feature conditioning☆29Updated last week
- Utilities for Processing the Switchboard Dialogue Act Corpus☆67Updated 3 years ago
- A repository for the 2022 Inflection Shared Task☆9Updated 2 years ago
- LOW-RESOURCE NEURAL MACHINE TRANSLATION: A BENCHMARK FOR FIVE AFRICAN LANGUAGES☆14Updated 4 years ago
- ☆42Updated 6 years ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆34Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated last month
- Sentence aligner☆106Updated 3 years ago
- Automatic extraction of edited sentences from text edition histories.☆80Updated 2 years ago
- ParCourE - Parallel Corpus Explorer☆12Updated 2 years ago
- Universal Romanizer that can convert any unicode script to roman (latin) script☆145Updated last month