Alternatives and similar repositories for ArabicMMLU

Users that are interested in ArabicMMLU are comparing it to the libraries listed below

• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆131Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆137Updated 8 months ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆133Updated last year
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated 2 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆104Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• ZurichNLP / multilingual-instruction-tuning
  Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"
  ☆25Updated 3 months ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆92Updated 10 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆94Updated 6 months ago
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆22Updated 7 months ago
• RUCAIBox / Language-Specific-Neurons
  ☆84Updated 8 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆148Updated 10 months ago
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆26Updated 6 months ago
• amazon-science / tofueval
  ☆31Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆103Updated 4 months ago
• qinyiwei / InfoBench
  ☆56Updated last year
• AlexTMallen / adaptive-retrieval
  ☆186Updated 2 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 10 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆175Updated 2 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆107Updated 6 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆80Updated last year
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆172Updated last month
• gsarti / pecore
  Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑
  ☆15Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆75Updated 4 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆63Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆79Updated last year
• asahi417 / lmppl
  Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …
  ☆163Updated 2 months ago