UBC-NLP / afrolidLinks
AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
โ31Updated 2 months ago
Alternatives and similar repositories for afrolid
Users that are interested in afrolid are comparing it to the libraries listed below
Sorting:
- ๐ Resource and Tool for Writing System Identification -- LREC 2024โ14Updated 11 months ago
- ๐ธ GlotWeb: Web Indexing for Low-Resource Languages -- under construction.โ13Updated 2 months ago
- Multilingual Open Textโ25Updated 3 weeks ago
- A tiny BERT for low-resource monolingual modelsโ31Updated 8 months ago
- A survey of corpora for Germanic low-resource languages and dialectsโ25Updated 6 months ago
- Curriculum trainingโ17Updated 2 months ago
- NTREX -- News Test References for MT Evaluationโ83Updated last year
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.โ105Updated last year
- A guide to building language technology in new languages.โ58Updated 3 years ago
- Tool to fix bitexts and tag near-duplicates for removalโ30Updated 4 months ago
- Statistics on multilingual datasetsโ17Updated 2 years ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.โ52Updated last month
- ParaNames: A multilingual resource for parallel namesโ32Updated last year
- BERT and ELECTRA models trained on Europeana Newspapersโ38Updated 3 years ago
- Morfessor EM+Pruneโ10Updated 4 years ago
- These are lists for a variety of languages containing words that are distinctive to each language.โ38Updated 3 years ago
- Sentiment Corpus for Swedish ๐ธ๐ช Norwegian ๐ณ๐ด Danish ๐ฉ๐ฐ Finnish ๐ซ๐ฎ (and English ๐ด๓ ง๓ ข๓ ฅ๓ ฎ๓ ง๓ ฟ)โ15Updated 4 years ago
- โ16Updated 3 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)โ74Updated 2 months ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinkiโ23Updated 3 months ago
- A simple neural truecaser written in pytorch and allennlp.โ33Updated 11 months ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Doโฆโ80Updated 11 months ago
- Zero-shot Transfer Learning from English to Arabicโ29Updated 2 years ago
- A python module for evaluating NERC and NEL system performances as defined in the HIPE shared tasks (formerly CLEF-HIPE-2020-scorer).โ14Updated last year
- Code and data for the IWSLT 2022 shared task on Formality Control for SLTโ21Updated 2 years ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.โ81Updated 8 months ago
- SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languagesโ9Updated last year
- This repository contains a demonstrative implementation for pooling-based models, e.g., DeepPyramidion complementing our paper "Sparsifyiโฆโ14Updated 3 years ago
- Featurize words into orthographic and phonological vectors.โ41Updated 2 years ago
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.โ75Updated last year