SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
☆28May 20, 2026Updated 5 months ago
Alternatives and similar repositories for sib-200
Users that are interested in sib-200 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crosslingual Question Answering for African Languages☆31Sep 27, 2024Updated 2 years ago
- COMET for African languages☆11Jan 24, 2025Updated last year
- [ACL 2023] Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages☆108Apr 14, 2026Updated 6 months ago
- [NAACL 2025] Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languages☆12May 31, 2024Updated 2 years ago
- Code for the paper: How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives (ACL …☆11May 25, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ACL 2025] 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Oct 31, 2026Updated last week
- This is an ASR corpus for Bemba language. It contains read speech from diverse publicly available Bemba sources; Literature Books, Radio/…☆41Jul 31, 2025Updated last year
- Large Scale Benchmark of Large Language Models on African Languages☆24Jul 28, 2025Updated last year
- ☆12Apr 24, 2025Updated last year
- AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages☆84May 31, 2022Updated 4 years ago
- [NAACL 2024] A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining☆18Nov 26, 2023Updated 2 years ago
- ☆15Mar 8, 2024Updated 2 years ago
- Goldfish: Monolingual language models for 350 languages.☆29Mar 4, 2026Updated 8 months ago
- Text pre-processing for NLP datasets☆12Dec 26, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A transcribed speech dataset in Wolof, Pulaar and Sereer, to support agriculture. Funded by Lacuna Fund.☆22Mar 26, 2026Updated 7 months ago
- ☆25Jan 22, 2024Updated 2 years ago
- This is a repository for NaijaSenti. A Lacuna Funded Project for the development of sentiment corpus for four Nigerian languages: Igbo, H…☆43Oct 14, 2025Updated last year
- MAFAND-MT☆65Jul 9, 2024Updated 2 years ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆18Oct 18, 2022Updated 4 years ago
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆70Oct 25, 2024Updated 2 years ago
- Toolkit used to collect translations from various online providers and LLMs☆14Jul 14, 2026Updated 3 months ago
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆18Sep 17, 2021Updated 5 years ago
- SeqScore: Scoring for named entity recognition and other sequence labeling tasks☆23Sep 3, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Data, Embeddings, Stopword lists, code, and baselines for COLING 2020 paper titled "KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text …☆15Apr 26, 2024Updated 2 years ago
- Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"☆29Jul 14, 2023Updated 3 years ago
- Synthetic Data Generation for Evaluation☆16Feb 21, 2025Updated last year
- FeedbackQA: Improving Question Answering Post-Deployment with Interactive Feedback☆12Jul 13, 2022Updated 4 years ago
- Building an effective preprocessing tool for African languages☆13Jan 24, 2024Updated 2 years ago
- Data and preprocessing scripts for SemEval 2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding☆16Feb 3, 2022Updated 4 years ago
- A python library for easily querying morphological inflection models trained on Unimorph☆13Oct 23, 2022Updated 4 years ago
- Evaluation framework for speech anonymizers☆12Mar 31, 2026Updated 7 months ago
- First comprehensive survey of NLP work carried out in Senegalese languages covering various tasks + Applications in the social sciences.☆39Aug 21, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple semi-supervised approach for creating huggingface data script loaders and upload to the hub.☆11Jun 23, 2024Updated 2 years ago
- [ACL 2024 Findings] Official code and data for ACL-2024 paper "X-Instruction: Aligning Language Model in Low-resource Languages with Self…☆10Jun 19, 2024Updated 2 years ago
- ☆10Feb 18, 2024Updated 2 years ago
- my solution for UC Berkeley AI projects pacman☆11Jul 25, 2020Updated 6 years ago
- Curate online wolof text resources that can be used to build models☆29Aug 16, 2026Updated 2 months ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆28Aug 8, 2025Updated last year
- Code for "BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition"☆32Jun 20, 2023Updated 3 years ago