Benchmark environment for evaluating vision-language models (VLMs) on popular video games!
☆367May 30, 2025Updated last year
Alternatives and similar repositories for videogamebench
Users that are interested in videogamebench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2026] LLM/VLM gaming agents and model evaluation through games.☆964Nov 16, 2025Updated 8 months ago
- Benchmarking Agentic LLM and VLM Reasoning On Games☆265Apr 9, 2026Updated 4 months ago
- 🕵 Code for our EMNLP 2025 Main paper: "FlashAdventure: A Benchmark for GUI Agents Solving Full Story Arcs in Diverse Adventure Games"☆27Apr 26, 2026Updated 3 months ago
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- ☆70Feb 4, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆155Jun 17, 2025Updated last year
- ☆17Apr 23, 2026Updated 3 months ago
- Tinker ↔ KernelBench Integration enabling RL for GPU Kernel Generation☆30Mar 5, 2026Updated 5 months ago
- ☆34May 31, 2025Updated last year
- Repo for Paper "OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraft"☆42Jun 5, 2026Updated 2 months ago
- A non-saturating, open-ended environment for evaluating LLMs in Factorio☆1,144Jun 11, 2026Updated 2 months ago
- NVFP4 Flash-Attention 4 on BlackWell☆39Jul 23, 2026Updated 3 weeks ago
- MiMo-VL☆643Aug 21, 2025Updated 11 months ago
- ☆121Feb 4, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆3,079Updated this week
- ☆13Nov 5, 2024Updated last year
- Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving stat…☆1,583Jun 14, 2025Updated last year
- Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos☆72Sep 5, 2025Updated 11 months ago
- Official Implementation of "JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse"☆166Aug 27, 2025Updated 11 months ago
- A Survey on Large Language Model-Based Game Agents (ACM CSUR)☆948Jun 7, 2026Updated 2 months ago
- Issue tracker for https://alphaxiv.org☆24Oct 13, 2025Updated 10 months ago
- ☆17Jan 6, 2026Updated 7 months ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,482Apr 17, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Evolutionary strategies finetuning library for LLMs☆25Jun 29, 2026Updated last month
- A step by step implementation of building an AI agent that plays 3d shooting game☆22Jul 16, 2025Updated last year
- Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning☆158Updated this week
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆417Updated this week
- Prompter for Embodied Instruction Following☆18Nov 30, 2023Updated 2 years ago
- Official repository of the spotlight ICML 2025 paper, PokeChamp: an Expert-level Minimax Language Agent.☆179Mar 11, 2026Updated 5 months ago
- Personal solutions to the Triton Puzzles☆21Jul 18, 2024Updated 2 years ago
- DIAMOND (DIffusion As a Model Of eNvironment Dreams) is a reinforcement learning agent trained in a diffusion world model. NeurIPS 2024 S…☆2,089Dec 6, 2024Updated last year
- ☆42Apr 9, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Implements the Messenger environment and EMMA model.☆25Jun 14, 2023Updated 3 years ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆618Aug 10, 2025Updated last year
- Ship correct and fast LLM kernels to PyTorch☆153Jan 14, 2026Updated 6 months ago
- Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay☆163May 29, 2025Updated last year
- ☆61May 21, 2025Updated last year
- G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning☆103May 20, 2025Updated last year
- Write a fast kernel and see how you compare against the best humans and AI on gpumode.com☆109Jul 29, 2026Updated 2 weeks ago