Skip to content
arXiv Game AI· Lanxiang Hu·· 28 d agoPickAI score50

WMEval: Evaluating interactive world models grounded on physical simulations

WMEval: Evaluating Interactive World Models Grounded on Physical Simulations

AI summary

WMEval evaluates interactive world models against Unity physics simulation as a reference. The benchmark covers 9 scenes and assesses action controllability, scene and character consistency, prompt following, kinematics, fluid dynamics, physical causality, and lighting. By executing matched action sequences in the simulator and in the world models and comparing the results, the paper argues that existing models still have substantial room for improvement in dimensions that standard perceptual metrics fail to capture.

Why it matters

Existing world model evaluations mostly look at perceptual similarity of frames; this work instead uses Unity physics simulation as a reference, adding a check of physical causal consistency.

Source: arXiv Game AI · arxiv.org