Waino / morfessor-emprune
Morfessor EM+Prune
☆10Updated 4 years ago
Related projects: ⓘ
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated last month
- NTREX -- News Test References for MT Evaluation☆73Updated 3 months ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- A guide to building language technology in new languages.☆57Updated 2 years ago
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆23Updated last year
- Bicleaner fork that uses neural networks☆37Updated last month
- A tiny BERT for low-resource monolingual models☆28Updated 4 months ago
- Curriculum training☆15Updated this week
- ☆12Updated 8 years ago
- A toolkit for producing n-gram language models. The highlights are the implementation of Kneser-Ney growing and revised Kneser pruning me…☆40Updated 2 weeks ago
- ☆17Updated 2 years ago
- Complimentary code for our paper Automatic punctuation restoration with BERT models☆48Updated 10 months ago
- Multilingual Open Text☆25Updated 5 months ago
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆36Updated last year
- ☆40Updated 2 years ago
- ☆42Updated last month
- ☆14Updated 5 years ago
- Universal Romanizer that can convert any unicode script to roman (latin) script☆145Updated last month
- ☆19Updated last month
- A library for minimum Bayes risk (MBR) decoding☆26Updated 3 weeks ago
- Code for extracting parallel corpora from pmindia☆16Updated 4 years ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆40Updated 9 months ago
- A survey of corpora for Germanic low-resource languages and dialects☆24Updated last month
- Efficient Low-Memory Aligner☆135Updated 2 weeks ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- SHAS: Approaching optimal Segmentation for End-to-End Speech Translation☆37Updated last year
- An adaptation of Fairseq to (End-to-end) speech translation.☆22Updated 2 years ago
- Source code for ASRU 2019 paper "Adapting Pretrained Transformer to Lattices for Spoken Language Understanding"☆11Updated 4 years ago
- Corpus preprocessing☆95Updated 6 months ago