Skip to content
arXiv Game AI· Zecong Tang·· 2026-10-22PickAI score50

HiSTEVE 1.0: human-interface VLA agents for open-world games

HiSTEVE 1.0: Harnessing Human-Interface VLA Agents for Open-World Games

AI summary

HiSTEVE 1.0 is a hierarchical VLA agent for open-world games such as Minecraft, in which a single VLA executes all subtasks using pure visual input and native keyboard-and-mouse actions. The paper reports that it scores 85.0% on MineStudio Bench and achieves an average success rate of 37.4% on OpenHA, with state-of-the-art performance on atomic tasks. The work also reports that the agent can synthesize long-horizon tasks such as an iron pickaxe from scratch, like a human player.

Why it matters

The paper combines high-level subtask planning and native keyboard-and-mouse visual control in one VLA agent, making it easier to compare the trade-off between long-horizon autonomy and the reliability of interface operation.

Source: arXiv Game AI · arxiv.org