HumanEval-V / HumanEval-V-BenchmarkLinks
A Lightweight Visual Reasoning Benchmark for Evaluating Large Multimodal Models through Complex Diagrams in Coding Tasks
☆12Updated 6 months ago
Alternatives and similar repositories for HumanEval-V-Benchmark
Users that are interested in HumanEval-V-Benchmark are comparing it to the libraries listed below
Sorting:
- ReasonFlux-Coder: Open-Source LLM Coders with Co-Evolving Reinforcement Learning☆111Updated last week
- ☆24Updated 3 months ago
- The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]☆87Updated 4 months ago
- ☆130Updated 2 weeks ago
- A Sober Look at Language Model Reasoning☆81Updated 2 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆97Updated last year
- 🚀 SWE-bench Goes Live!☆115Updated last month
- SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433☆28Updated 9 months ago
- ☆41Updated 4 months ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆110Updated 4 months ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆65Updated last month
- [2025-TMLR] A Survey on the Honesty of Large Language Models☆59Updated 8 months ago
- Pitfalls of Rule- and Model-based Verifiers: A Case Study on Mathematical Reasoning.☆23Updated 3 months ago
- ☆17Updated 4 months ago
- [EMNLP 2024] Multi-modal reasoning problems via code generation.☆24Updated 7 months ago
- Reproducing R1 for Code with Reliable Rewards☆252Updated 4 months ago
- ☆58Updated 2 months ago
- [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.☆80Updated 6 months ago
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents☆121Updated 5 months ago
- The rule-based evaluation subset and code implementation of Omni-MATH☆22Updated 8 months ago
- ☆50Updated last month
- This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"☆50Updated 10 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆61Updated last year
- End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning☆190Updated this week
- ☆93Updated 2 weeks ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆85Updated 6 months ago
- [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style☆60Updated last month
- ☆20Updated 6 months ago
- ☆32Updated 2 months ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆64Updated 3 months ago