Alternatives and similar repositories for MM-Eval

Users that are interested in MM-Eval are comparing it to the libraries listed below

• Cohere-Labs-Community / m-rewardbench
  Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)
  ☆35Updated 5 months ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆93Updated 11 months ago
• aviclu / ffn-values
  ☆64Updated 2 years ago
• joeljang / continual-knowledge-learning
  [ICLR 2022] Towards Continual Knowledge Learning of Language Models
  ☆92Updated 3 years ago
• MattYoon / reasoning-models-confidence
  [NeurIPS 2025] Reasoning Models Better Express Their Confidence"
  ☆19Updated last month
• joeljang / temporalwiki
  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  ☆74Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆132Updated last year
• roeehendel / icl_task_vectors
  ☆98Updated last year
• AlexTMallen / adaptive-retrieval
  ☆189Updated 3 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆138Updated 9 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆117Updated 2 years ago
• SimengSun / alpaca_farm_lora
  ☆22Updated 2 years ago
• prometheus-eval / scaling-evaluation-compute
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"
  ☆12Updated 6 months ago
• lukemelas / mtob
  ☆40Updated last year
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆31Updated 2 years ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆202Updated 5 months ago
• protagolabs / odyssey-math
  ☆83Updated 8 months ago
• liujch1998 / memo-trap
  ☆22Updated 2 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆51Updated last year
• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆218Updated last year
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆117Updated 2 years ago
• nayeon7lee / FactualityPrompt
  ☆86Updated 2 years ago
• nlee0212 / BLEnD
  BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages
  ☆37Updated 2 months ago
• nyu-mll / quality
  ☆141Updated 9 months ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆28Updated 4 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆54Updated last year
• balevinstein / Probes
  ☆56Updated 2 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆96Updated 4 years ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆204Updated last year