Alternatives and similar repositories for ArabicMMLU

Users that are interested in ArabicMMLU are comparing it to the libraries listed below

• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated 2 years ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated 2 years ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆131Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆104Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆138Updated 8 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆133Updated last year
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆22Updated 8 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆92Updated 11 months ago
• RUCAIBox / Language-Specific-Neurons
  ☆84Updated 9 months ago
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆103Updated last week
• ZurichNLP / multilingual-instruction-tuning
  Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"
  ☆25Updated 4 months ago
• jakespringer / echo-embeddings
  ☆155Updated last year
• asahi417 / lmppl
  Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …
  ☆162Updated 3 months ago
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆22Updated 2 years ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 10 months ago
• AlexTMallen / adaptive-retrieval
  ☆189Updated 3 months ago
• gsarti / pecore
  Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑
  ☆15Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆201Updated 10 months ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆116Updated 6 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆94Updated 7 months ago
• amazon-science / tofueval
  ☆31Updated last year
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆148Updated 11 months ago
• DAMO-NLP-SG / multilingual_analysis
  [NeurIPS 2024] How do Large Language Models Handle Multilingualism?
  ☆41Updated 11 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• hsing-wang / Awesome-LLM-MT
  ☆246Updated last year
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆50Updated last year
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆99Updated 3 months ago