Alternatives and similar repositories for ArabicMMLU

Users that are interested in ArabicMMLU are comparing it to the libraries listed below

• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆96Updated 2 years ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆96Updated 2 years ago
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆23Updated 11 months ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆71Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆107Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated last year
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆95Updated 10 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆226Updated last year
• qinyiwei / InfoBench
  ☆58Updated last year
• wxjiao / ParroT
  The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…
  ☆176Updated last year
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆74Updated 8 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• ZurichNLP / multilingual-instruction-tuning
  Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"
  ☆25Updated 7 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆148Updated last year
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆113Updated 3 months ago
• AIR-Bench / AIR-Bench
  [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆166Updated 3 months ago
• CONE-MT / LLaMAX
  ☆72Updated last year
• jakespringer / echo-embeddings
  ☆162Updated last year
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆95Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆110Updated 11 months ago
• awslabs / rag-qa-arena
  ☆51Updated last year
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆104Updated 7 months ago
• FreedomIntelligence / AceGPT
  ☆127Updated last year
• MicrosoftTranslator / GEMBA
  GEMBA — GPT Estimation Metric Based Assessment
  ☆141Updated last month
• LightChen233 / Awesome-Multilingual-LLM
  ☆124Updated last year
• Glaciohound / LM-Steer
  Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)
  ☆134Updated 6 months ago