Alternatives and similar repositories for COFFTEA:

Users that are interested in COFFTEA are comparing it to the libraries listed below

• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆29Updated 9 months ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 7 months ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆21Updated 4 months ago
• dqxiu / KAssess
  ☆15Updated last year
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆24Updated last year
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆38Updated 7 months ago
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated 10 months ago
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• GAIR-NLP / BeHonest
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆31Updated 8 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆58Updated 4 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 8 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 4 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆49Updated 6 months ago
• WeiminXiong / RationaleCL
  Rationale-enhanced language models are better continual relation learners (EMNLP 2023 Main Conference)
  ☆12Updated last year
• PKU-TANGENT / ConFiguRe
  Dataset and baseline for Coling 2022 long paper (oral): "ConFiguRe: Exploring Discourse-level Chinese Figures of Speech"
  ☆11Updated last year
• sail-sg / ActivePRM
  ☆15Updated 2 weeks ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆33Updated 9 months ago
• LuoXiaoHeics / Continual-Tune
  ☆10Updated 3 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆53Updated last week
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆60Updated 9 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 10 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆46Updated 6 months ago
• rookie-joe / AutoPSV
  ☆44Updated 6 months ago
• lscpku / VITATECS
  ☆18Updated 9 months ago
• hkust-nlp / GUIMid
  ☆18Updated this week
• YujieLu10 / Seeker
  ☆10Updated 11 months ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago