Skip to content
arXiv Game AI· Jihai Zhang·· 17 d agoPickAI score71

PlayGen2: Learning real-time playable worlds with explicit 3D state

PlayGen2: Learning Real-Time Playable Worlds with Explicit 3D State

AI summary

The authors propose PlayGen2, a real-time interactive world model that separates learned 3D state evolution from neural rendering, using a volumetric occupancy grid and an identity-indexed 3D state to maintain persistent world memory. Tested on Doom, the model learned world dynamics including geometry-aware player movement and player-NPC interaction, and the full simulation and rendering pipeline runs at about 160ms backend latency on a MacBook Pro with an M4 Pro chip.

Why it matters

The paper splits a playable world into explicit 3D state evolution and neural rendering, and reports measured latency and zero-shot transfer results, making it easier to judge whether such world models can support real-time interaction.

Source: arXiv Game AI · arxiv.org