UBC-NLP / afrolid
AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
☆31Updated 3 weeks ago
Alternatives and similar repositories for afrolid:
Users that are interested in afrolid are comparing it to the libraries listed below
- Curriculum training☆17Updated 3 weeks ago
- 🖋 Resource and Tool for Writing System Identification -- LREC 2024☆13Updated 9 months ago
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆103Updated 11 months ago
- Code for extracting parallel corpora from pmindia☆16Updated 5 years ago
- A survey of corpora for Germanic low-resource languages and dialects☆25Updated 3 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆51Updated 2 months ago
- NTREX -- News Test References for MT Evaluation☆81Updated 9 months ago
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated last month
- A tiny BERT for low-resource monolingual models☆31Updated 6 months ago
- Multilingual Open Text☆25Updated 5 months ago
- This code provides word level language identification tool for identifying language for individual words in Code-Mixed text. e.g. The tex…☆53Updated 4 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆70Updated 11 months ago
- The central repo for Creole based NLU and NLG work☆18Updated 10 months ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- BERT and ELECTRA models trained on Europeana Newspapers☆37Updated 3 years ago
- ☆26Updated last month
- A guide to building language technology in new languages.☆58Updated 3 years ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆37Updated 2 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆80Updated 8 months ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- ☆109Updated last year
- Machine translation (MT) benchmark dataset for languages in the Horn of Africa.☆39Updated 2 years ago
- ☆17Updated 2 years ago
- ☆42Updated 3 years ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆22Updated last month
- AfriSenti-SemEval Shared Task 12: Sentiment Analysis for African languages : https://afrisenti-semeval.github.io/☆48Updated last year
- ☆64Updated 2 years ago
- OpusFilter - Parallel corpus processing toolkit☆104Updated this week
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆74Updated last year
- Creating super-parallel corpora of more than 1500+ unique languages for NLP research☆33Updated 2 years ago