PlayGen2: Learning real-time playable worlds with explicit 3D state
PlayGen2: Learning Real-Time Playable Worlds with Explicit 3D State
The authors propose PlayGen2, a real-time interactive world model that separates learned 3D state evolution from neural rendering, using a volumetric occupancy grid and an identity-indexed 3D state to maintain persistent world memory. Tested on Doom, the model learned world dynamics including geometry-aware player movement and player-NPC interaction, and the full simulation and rendering pipeline runs at about 160ms backend latency on a MacBook Pro with an M4 Pro chip.
The paper splits a playable world into explicit 3D state evolution and neural rendering, and reports measured latency and zero-shot transfer results, making it easier to judge whether such world models can support real-time interaction.
Source: arXiv Game AI · arxiv.org