Skip to content
arXiv Game AI· Advait Gupta·· 2026-10-23AI score24

AgentVQA: a unified benchmark for agentic visual understanding

AgentVQA: A Unified Benchmark for Agentic Visual Understanding

AI summary

AgentVQA proposes an offline visual question answering benchmark for evaluating vision-language models (VLMs) across five scenarios: web agents, robotics, first-person video, games, and spatial planning. Built by manually selecting 1,000 challenging real agent samples from 23 source datasets, the benchmark's model rankings are claimed to match those of corresponding online evaluations.

Source: arXiv Game AI · arxiv.org