Alternatives and similar repositories for HumanEval-V-Benchmark

Users that are interested in HumanEval-V-Benchmark are comparing it to the libraries listed below

• GeniusHTX / TALE
  ☆99Updated last week
• likaixin2000 / MMCode
  [EMNLP 2024] Multi-modal reasoning problems via code generation.
  ☆23Updated 3 months ago
• zhxieml / remiss-jailbreak
  ☆28Updated 10 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆58Updated 4 months ago
• CodeEval-Pro / CodeEval-Pro
  Official repo for "HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task"
  ☆27Updated last month
• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆29Updated 4 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆59Updated 3 months ago
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆22Updated last week
• ShuheSH / A-Survey-of-the-Reasoning-Abilities-of-LLMs
  ☆22Updated 2 months ago
• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆45Updated this week
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆95Updated last week
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆57Updated 5 months ago
• mingyin1 / Agents_Failure_Attribution
  ☆46Updated last week
• TIGER-AI-Lab / AceCoder
  The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis"
  ☆82Updated last month
• ShadeCloak / ADORA
  ☆43Updated last month
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆61Updated 5 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆72Updated 7 months ago
• AI4Good24 / PsySafe
  ☆43Updated 3 months ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆21Updated 4 months ago
• xbmxb / EnvDistraction
  ☆19Updated 7 months ago
• ZhentingWang / DUMP
  ☆16Updated last week
• hkust-nlp / GUIMid
  ☆18Updated 2 weeks ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆22Updated 2 months ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆190Updated last week
• ise-uiuc / xft
  XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
  ☆31Updated 10 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆93Updated 11 months ago
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆34Updated last month
• RUCKBReasoning / CodeRM
  The code of arXiv paper: "Dynamic Scaling of Unit Tests for Code Reward Modeling"
  ☆19Updated 4 months ago
• KodCode-AI / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆10Updated last month
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆67Updated 3 months ago