UBC-NLP / afrolidLinks
AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
☆35Updated this week
Alternatives and similar repositories for afrolid
Users that are interested in afrolid are comparing it to the libraries listed below
Sorting:
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆17Updated 5 months ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 10 months ago
- NTREX -- News Test References for MT Evaluation☆88Updated last year
- A survey of corpora for Germanic low-resource languages and dialects☆26Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆57Updated last week
- ☆50Updated last year
- Curriculum training☆22Updated 7 months ago
- 🖋 Resource and Tool for Writing System Identification -- LREC 2024☆21Updated last month
- ☆117Updated 3 months ago
- OpusFilter - Parallel corpus processing toolkit☆115Updated this week
- A tiny BERT for low-resource monolingual models☆31Updated last month
- Multilingual Open Text☆25Updated 9 months ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆41Updated 3 years ago
- A module to compute textual lexical richness (aka lexical diversity).☆112Updated 2 years ago
- ☆81Updated last week
- ParaNames: A multilingual resource for parallel names☆39Updated last year
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆81Updated last year
- Creating super-parallel corpora of more than 1500+ unique languages for NLP research☆34Updated 3 years ago
- Machine translation (MT) benchmark dataset for languages in the Horn of Africa.☆40Updated 3 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 5 months ago
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆113Updated last year
- A tool that locates, downloads, and extracts machine translation corpora☆162Updated 4 months ago
- Statistics on multilingual datasets☆17Updated 3 years ago
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆99Updated 3 years ago
- ☆45Updated 3 years ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆22Updated 2 years ago
- Easier Automatic Sentence Simplification Evaluation☆166Updated 2 years ago
- Linguistic and stylistic complexity measures for (literary) texts☆84Updated 2 years ago
- A spaCy custom component that extracts and normalizes temporal expressions☆56Updated 2 years ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆30Updated this week