Skip to content
arXiv Game World Models & Generation· Shuzhi Liu·· 27 d agoPickAI score49

How humans learn unfamiliar worlds: a think-aloud dataset on ARC-AGI-3

How Humans Learn Unfamiliar Worlds: A Think-Aloud Dataset on ARC-AGI-3

AI summary

Researchers built a think-aloud dataset that records how humans explore and learn unfamiliar game mechanics. It contains 144 human trajectories from 64 participants across 25 public games, plus 250 LLM agent trajectories. The analysis shows that qualitative representation makes up 50.0% of successful human trajectories versus 14.3% of successful LLM trajectories, and humans more often explore without a specific hypothesis.

Why it matters

This paper uses think-aloud human game trajectories to compare with the failure and recovery processes of LLM agents, offering a reference for examining the limitations of existing game-agent benchmarks.

Source: arXiv Game World Models & Generation · arxiv.org