Alternatives and similar repositories for MM-Eval

Users that are interested in MM-Eval are comparing it to the libraries listed below

• Cohere-Labs-Community / m-rewardbench
  Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)
  ☆38Updated 6 months ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆95Updated last year
• MattYoon / reasoning-models-confidence
  [NeurIPS 2025] Reasoning Models Better Express Their Confidence"
  ☆21Updated 2 weeks ago
• joeljang / temporalwiki
  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  ☆74Updated last year
• joeljang / continual-knowledge-learning
  [ICLR 2022] Towards Continual Knowledge Learning of Language Models
  ☆92Updated 3 years ago
• aviclu / ffn-values
  ☆67Updated 2 years ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• prometheus-eval / scaling-evaluation-compute
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"
  ☆12Updated 8 months ago
• AlexTMallen / adaptive-retrieval
  ☆189Updated 5 months ago
• nayeon7lee / FactualityPrompt
  ☆87Updated 3 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• Columbia-NLP-Lab / LionAlignment
  ☆12Updated last year
• Cohere-Labs-Community / language-confusion
  Repository for the "Understanding and Mitigating Language Confusion in LLMs" paper
  ☆30Updated last year
• liujch1998 / memo-trap
  ☆22Updated 2 years ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 10 months ago
• roeehendel / icl_task_vectors
  ☆102Updated 2 years ago
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆33Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆54Updated last year
• naver-ai / ALMoST
  ☆24Updated 2 years ago
• Shivanshu-Gupta / icl-coverage
  ☆13Updated last year
• SimengSun / alpaca_farm_lora
  ☆22Updated 2 years ago
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆282Updated 3 years ago
• amy-hyunji / Contextualized-Generative-Retrieval
  ☆15Updated 3 years ago
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆22Updated 3 years ago
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• balevinstein / Probes
  ☆57Updated 2 years ago
• McGill-NLP / feedbackqa
  FeedbackQA: Improving Question Answering Post-Deployment with Interactive Feedback
  ☆12Updated 3 years ago
• SimengSun / ChapterBreak
  ☆11Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆293Updated 2 weeks ago