arXiv Game AI· Advait Gupta·· 2026-10-23AI score24
AgentVQA: a unified benchmark for agentic visual understanding
AgentVQA: A Unified Benchmark for Agentic Visual Understanding
AI summary
AgentVQA proposes an offline visual question answering benchmark for evaluating vision-language models (VLMs) across five scenarios: web agents, robotics, first-person video, games, and spatial planning. Built by manually selecting 1,000 challenging real agent samples from 23 source datasets, the benchmark's model rankings are claimed to match those of corresponding online evaluations.
Source: arXiv Game AI · arxiv.org