UBC-NLP / afrolid
AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
☆31Updated last year
Alternatives and similar repositories for afrolid:
Users that are interested in afrolid are comparing it to the libraries listed below
- Curriculum training☆16Updated last month
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆102Updated 9 months ago
- Resource and Tool for Writing System Identification -- LREC 2024☆13Updated 8 months ago
- NTREX -- News Test References for MT Evaluation☆81Updated 8 months ago
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated 2 weeks ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆70Updated 9 months ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆35Updated 2 years ago
- A guide to building language technology in new languages.☆58Updated 3 years ago
- Code for extracting parallel corpora from pmindia☆16Updated 5 years ago
- Crosslingual Question Answering for African Languages☆29Updated 4 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆49Updated last month
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆22Updated last week
- A survey of corpora for Germanic low-resource languages and dialects☆24Updated 2 months ago
- Machine translation (MT) benchmark dataset for languages in the Horn of Africa.☆39Updated 2 years ago
- ☆42Updated 3 years ago
- Morfessor EM+Prune☆10Updated 4 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆79Updated 7 months ago
- Open information and community for machine translation☆73Updated last week
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- A french sequence to sequence pretrained model☆57Updated 2 years ago
- A spaCy custom component that extracts and normalizes temporal expressions☆54Updated 2 years ago
- Multilingual Open Text☆25Updated 3 months ago
- This repository contains the HiNER dataset released with our paper at LREC 2022☆14Updated last year
- OpusFilter - Parallel corpus processing toolkit☆104Updated 3 weeks ago
- Caucasus languages focused multilingual and monolingual corpuses for Natural Language Processing(NLP)☆34Updated 2 months ago
- ☆14Updated 2 years ago
- A tiny BERT for low-resource monolingual models☆31Updated 4 months ago
- SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages☆8Updated last year
- Statistics on multilingual datasets☆17Updated 2 years ago
- Agile reading group that works☆13Updated 3 years ago