Caucasus-Rosetta / Lingua-Corpus
Caucasus languages focused multilingual and monolingual corpuses for Natural Language Processing(NLP)
☆34Updated 2 months ago
Alternatives and similar repositories for Lingua-Corpus:
Users that are interested in Lingua-Corpus are comparing it to the libraries listed below
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- NTREX -- News Test References for MT Evaluation☆81Updated 8 months ago
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆24Updated last year
- Curriculum training☆16Updated last month
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- OpusFilter - Parallel corpus processing toolkit☆104Updated 3 weeks ago
- Bicleaner fork that uses neural networks☆39Updated 6 months ago
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆40Updated last year
- A survey of corpora for Germanic low-resource languages and dialects☆24Updated 2 months ago
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated 2 weeks ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆35Updated 2 years ago
- Code for extracting parallel corpora from pmindia☆16Updated 5 years ago
- ☆19Updated 3 years ago
- ☆25Updated last year
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated last year
- ☆15Updated last year
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- ParCourE - Parallel Corpus Explorer☆12Updated 3 years ago
- Creating super-parallel corpora of more than 1500+ unique languages for NLP research☆32Updated 2 years ago
- A tiny BERT for low-resource monolingual models☆31Updated 4 months ago
- Efficient Low-Memory Aligner☆141Updated last month
- ☆45Updated 6 months ago
- An educational tool to train, inspect, evaluate and translate using neural engines☆18Updated last week
- A accurate multilingual word aligner based on LaBSE☆20Updated last year
- This code provides word level language identification tool for identifying language for individual words in Code-Mixed text. e.g. The tex…☆51Updated 4 years ago
- Morfessor EM+Prune☆10Updated 4 years ago
- ☆12Updated 3 years ago
- MAGPIE: A sense-annotated corpus of potentially idiomatic expressions☆26Updated 4 years ago
- SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages☆8Updated last year
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆35Updated 7 months ago