Alternatives and similar repositories for MM-Eval

Users that are interested in MM-Eval are comparing it to the libraries listed below

• Cohere-Labs-Community / m-rewardbench
  Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)
  ☆39Updated 7 months ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆95Updated last year
• aviclu / ffn-values
  ☆67Updated 2 years ago
• joeljang / continual-knowledge-learning
  [ICLR 2022] Towards Continual Knowledge Learning of Language Models
  ☆92Updated 3 years ago
• MattYoon / reasoning-models-confidence
  [NeurIPS 2025] Reasoning Models Better Express Their Confidence"
  ☆21Updated last month
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• joeljang / temporalwiki
  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  ☆74Updated last year
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆22Updated 3 years ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 11 months ago
• Shivanshu-Gupta / icl-coverage
  ☆13Updated last year
• AlexTMallen / adaptive-retrieval
  ☆189Updated 5 months ago
• nyu-mll / quality
  ☆145Updated 11 months ago
• liujch1998 / memo-trap
  ☆22Updated 2 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago
• swj0419 / in-context-pretraining
  ☆55Updated last year
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆33Updated 2 years ago
• nayeon7lee / FactualityPrompt
  ☆88Updated 3 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆118Updated 2 years ago
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• DAMO-NLP-SG / multilingual_analysis
  [NeurIPS 2024] How do Large Language Models Handle Multilingualism?
  ☆47Updated last year
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆29Updated 9 months ago
• pytorch-tpu / transformers
  🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.
  ☆17Updated 6 months ago
• aqweteddy / ChatVector
  Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …
  ☆58Updated last year
• kaistAI / How-Well-Do-LLMs-Truly-Ground
  ☆11Updated 3 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆207Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆305Updated last month
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆29Updated 6 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆23Updated last year