Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
☆342Dec 18, 2024Updated last year
Alternatives and similar repositories for belebele
Users that are interested in belebele are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Aug 18, 2023Updated 3 years ago
- ☆278Aug 1, 2025Updated last year
- SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects☆28May 20, 2026Updated 5 months ago
- COMET for African languages☆11Jan 24, 2025Updated last year
- [ACL 2023] Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages☆108Apr 14, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [NeurIPS 2024] 🕸 GlotCC Dataset and Pipline☆21Apr 6, 2025Updated last year
- Facebook Low Resource (FLoRes) MT Benchmark☆770Nov 20, 2023Updated 2 years ago
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆199Sep 11, 2026Updated last month
- A Multilingual Keyboard Layout-Based Typo Generator☆19Nov 23, 2025Updated 11 months ago
- [NAACL 2025] Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languages☆12May 31, 2024Updated 2 years ago
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation☆14Aug 19, 2025Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,417Updated this week
- ☆1,274Jul 30, 2024Updated 2 years ago
- Python intefrace for evaluation on chatgpt models☆19Feb 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NTREX -- News Test References for MT Evaluation☆88Jun 5, 2024Updated 2 years ago
- code for Teaching LM to Translate with Comparison☆39Dec 15, 2023Updated 2 years ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆223Sep 18, 2025Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆135Aug 21, 2024Updated 2 years ago
- Shami Dialect Corpus (SDC)☆30Feb 13, 2018Updated 8 years ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆29Apr 2, 2022Updated 4 years ago
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆58Aug 31, 2026Updated 2 months ago
- #인권코퍼스☆31Oct 6, 2023Updated 3 years ago
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆177Dec 31, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,174Oct 8, 2024Updated 2 years ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆30Apr 17, 2024Updated 2 years ago
- contrastive decoding☆207Nov 14, 2022Updated 3 years ago
- ☆1,600Mar 25, 2026Updated 7 months ago
- ☆52Jun 20, 2024Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆50Nov 13, 2023Updated 2 years ago
- TART: A plug-and-play Transformer module for task-agnostic reasoning☆202Jun 22, 2023Updated 3 years ago
- Foundational Models for State-of-the-Art Speech and Text Translation☆11,904Sep 8, 2026Updated last month
- Robust recipes to align language models with human and AI preferences☆5,711Sep 23, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆10Oct 2, 2024Updated 2 years ago
- ☆20Apr 21, 2026Updated 6 months ago
- Code for fine-tuning Platypus fam LLMs using LoRA☆624Feb 4, 2024Updated 2 years ago
- Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures☆12May 29, 2026Updated 5 months ago
- Crosslingual Question Answering for African Languages☆31Sep 27, 2024Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Aug 25, 2023Updated 3 years ago
- Microsoft Automatic Mixed Precision Library☆635Dec 1, 2025Updated 11 months ago