castorini / afriberta
AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages
☆72Updated 2 years ago
Alternatives and similar repositories for afriberta:
Users that are interested in afriberta are comparing it to the libraries listed below
- MAFAND-MT☆55Updated 8 months ago
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆103Updated 11 months ago
- ☆109Updated last year
- Crosslingual Question Answering for African Languages☆29Updated 6 months ago
- ☆17Updated 2 years ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆124Updated 4 months ago
- Some notebooks for NLP☆199Updated last year
- This is a neural spell checker☆65Updated 2 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 2 years ago
- A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models☆31Updated 3 years ago
- Yorùbá language training text for NLP, ASR and TTS tasks☆76Updated 2 years ago
- NTREX -- News Test References for MT Evaluation☆81Updated 9 months ago
- ☆87Updated 3 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- MasakhaNEWS: News Topic Classification for African Languages☆23Updated 10 months ago
- Tools for managing datasets for governance and training.☆83Updated 2 months ago
- A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️☆36Updated 2 years ago
- Small repo describing how to use Hugging Face's Wav2Vec2 with PyCTCDecode☆111Updated 2 years ago
- Open information and community for machine translation☆74Updated last week
- CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed dat…☆34Updated 4 years ago
- A tiny BERT for low-resource monolingual models☆31Updated 6 months ago
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated 11 months ago
- ☆43Updated last year
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆153Updated 10 months ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆80Updated 6 months ago
- A simple semi-supervised approach for creating huggingface data script loaders and upload to the hub.☆11Updated 9 months ago
- Python-based implementation of the Translate-Align-Retrieve method to automatically translate the SQuAD Dataset to Spanish.☆59Updated 2 years ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆78Updated last year
- Data, Embeddings, Stopword lists, code, and baselines for COLING 2020 paper titled "KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text …☆12Updated 11 months ago
- This is a repository for NaijaSenti. A Lacuna Funded Project for the development of sentiment corpus for four Nigerian languages: Igbo, H…☆32Updated last year